-
Predictability of climate tip** focusing on the internal variability of the Earth system
Authors:
Amane Kubo,
Yohei Sawada
Abstract:
Prediction of climate tip** is challenging due to the lack of recent observation of actual climate tip**. Despite many previous efforts to accurately predict the existence and timing of climate tip**s under specific climate scenarios, the predictability of climate tip**, the necessary conditions under which climate tip** can be predicted, has yet to be explored. In this study, the predic…
▽ More
Prediction of climate tip** is challenging due to the lack of recent observation of actual climate tip**. Despite many previous efforts to accurately predict the existence and timing of climate tip**s under specific climate scenarios, the predictability of climate tip**, the necessary conditions under which climate tip** can be predicted, has yet to be explored. In this study, the predictability of climate tip** is analyzed by Observation System Simulation Experiment (OSSE), in which the value of observation for prediction is assessed through the idealized experiment of data assimilation, using a simplified dynamic vegetation model and an Atlantic Meridional Overturning Circulation (AMOC) two box model. We find that the ratio of internal variability to observation error, or signal-to-noise ratio, should be large enough to accurately predict climate tip**s. When observation can accurately resolve the internal variability of the system, assimilating these observations into process-based models can effectively improve the skill of predicting climate tip**s. Our quantitative estimation of required observation accuracy to predict climate tip** implies that the existing observation network is not always sufficient to accurately project climate tip**.
△ Less
Submitted 28 June, 2024;
originally announced June 2024.
-
Quest for an efficient mathematical and computational method to explore optimal extreme weather modification
Authors:
Yohei Sawada
Abstract:
It is a grand challenge to find a feasible weather modification method to mitigate the impact of extreme weather events such as tropical cyclones. Previous works have proposed potentially effective actuators and assessed their capabilities to achieve weather modification objectives through numerical simulations. However, few studies have explored efficient mathematical and computational methods to…
▽ More
It is a grand challenge to find a feasible weather modification method to mitigate the impact of extreme weather events such as tropical cyclones. Previous works have proposed potentially effective actuators and assessed their capabilities to achieve weather modification objectives through numerical simulations. However, few studies have explored efficient mathematical and computational methods to inversely determine optimal actuators from specific modification goals. Here I demonstrate the utility of the ensemble Kalman filter (EnKF)-based control method, referred to as ensemble Kalman control (EnKC). The series of numerical experiments with the Lorenz 96 model indicates that EnKC efficiently identifies local, small, and intermittent control perturbations that can mitigate extreme events. The existing techniques of EnKF, such as background error covariance localization and observation error covariance inflation, can improve the sparsity and efficiency of the control. This work paves the way toward the real-world applications of EnKC to explore the controllability of extreme atmospheric events.
△ Less
Submitted 14 May, 2024;
originally announced May 2024.
-
Magic for the Age of Quantized DNNs
Authors:
Yoshihide Sawada,
Ryuji Saiin,
Kazuma Suetake
Abstract:
Recently, the number of parameters in DNNs has explosively increased, as exemplified by LLMs (Large Language Models), making inference on small-scale computers more difficult. Model compression technology is, therefore, essential for integration into products. In this paper, we propose a method of quantization-aware training. We introduce a novel normalization (Layer-Batch Normalization) that is i…
▽ More
Recently, the number of parameters in DNNs has explosively increased, as exemplified by LLMs (Large Language Models), making inference on small-scale computers more difficult. Model compression technology is, therefore, essential for integration into products. In this paper, we propose a method of quantization-aware training. We introduce a novel normalization (Layer-Batch Normalization) that is independent of the mini-batch size and does not require any additional computation cost during inference. Then, we quantize the weights by the scaled round-clip function with the weight standardization. We also quantize activation functions using the same function and apply surrogate gradients to train the model with both quantized weights and the quantized activation functions. We call this method Magic for the age of Quantised DNNs (MaQD). Experimental results show that our quantization method can be achieved with minimal accuracy degradation.
△ Less
Submitted 22 March, 2024;
originally announced March 2024.
-
Upper Bound of Bayesian Generalization Error in Partial Concept Bottleneck Model (CBM): Partial CBM outperforms naive CBM
Authors:
Naoki Hayashi,
Yoshihide Sawada
Abstract:
Concept Bottleneck Model (CBM) is a methods for explaining neural networks. In CBM, concepts which correspond to reasons of outputs are inserted in the last intermediate layer as observed values. It is expected that we can interpret the relationship between the output and concept similar to linear regression. However, this interpretation requires observing all concepts and decreases the generaliza…
▽ More
Concept Bottleneck Model (CBM) is a methods for explaining neural networks. In CBM, concepts which correspond to reasons of outputs are inserted in the last intermediate layer as observed values. It is expected that we can interpret the relationship between the output and concept similar to linear regression. However, this interpretation requires observing all concepts and decreases the generalization performance of neural networks. Partial CBM (PCBM), which uses partially observed concepts, has been devised to resolve these difficulties. Although some numerical experiments suggest that the generalization performance of PCBMs is almost as high as that of the original neural networks, the theoretical behavior of its generalization error has not been yet clarified since PCBM is singular statistical model. In this paper, we reveal the Bayesian generalization error in PCBM with a three-layered and linear architecture. The result indcates that the structure of partially observed concepts decreases the Bayesian generalization error compared with that of CBM (full-observed concepts).
△ Less
Submitted 14 March, 2024;
originally announced March 2024.
-
Ensemble Kalman filter in geoscience meets model predictive control
Authors:
Yohei Sawada
Abstract:
Although data assimilation originates from control theory, the relationship between modern data assimilation methods in geoscience and model predictive control has not been extensively explored. In the present paper, I discuss that the modern data assimilation methods in geoscience and model predictive control essentially minimize the similar quadratic cost functions. Inspired by this similarity,…
▽ More
Although data assimilation originates from control theory, the relationship between modern data assimilation methods in geoscience and model predictive control has not been extensively explored. In the present paper, I discuss that the modern data assimilation methods in geoscience and model predictive control essentially minimize the similar quadratic cost functions. Inspired by this similarity, I propose a new ensemble Kalman filter (EnKF)-based method for controlling spatio-temporally chaotic systems, which can readily be applied to high-dimensional and nonlinear Earth systems. In this method, the reference vector, which serves as the control target, is assimilated into the state space as a pseudo-observation by ensemble Kalman smoother to obtain the appropriate perturbation to be added to a system. A proof-of-concept experiment using the Lorenz 63 model is presented. The system is constrained in one wing of the butterfly attractor without tip** to the other side by reasonably small control perturbations which are comparable with previous works.
△ Less
Submitted 15 March, 2024; v1 submitted 10 March, 2024;
originally announced March 2024.
-
Can Transformers Predict Vibrations?
Authors:
Fusataka Kuniyoshi,
Yoshihide Sawada
Abstract:
Highly accurate time-series vibration prediction is an important research issue for electric vehicles (EVs). EVs often experience vibrations when driving on rough terrains, known as torsional resonance. This resonance, caused by the interaction between motor and tire vibrations, puts excessive loads on the vehicle's drive shaft. However, current dam** technologies only detect resonance after the…
▽ More
Highly accurate time-series vibration prediction is an important research issue for electric vehicles (EVs). EVs often experience vibrations when driving on rough terrains, known as torsional resonance. This resonance, caused by the interaction between motor and tire vibrations, puts excessive loads on the vehicle's drive shaft. However, current dam** technologies only detect resonance after the vibration amplitude of the drive shaft torque reaches a certain threshold, leading to significant loads on the shaft at the time of detection. In this study, we propose a novel approach to address this issue by introducing Resoformer, a transformer-based model for predicting torsional resonance. Resoformer utilizes time-series of the motor rotation speed as input and predicts the amplitude of torsional vibration at a specified quantile occurring in the shaft after the input series. By calculating the attention between recursive and convolutional features extracted from the measured data points, Resoformer improves the accuracy of vibration forecasting. To evaluate the model, we use a vibration dataset called VIBES (Dataset for Forecasting Vibration Transition in EVs), consisting of 2,600 simulator-generated vibration sequences. Our experiments, conducted on strong baselines built on the VIBES dataset, demonstrate that Resoformer achieves state-of-the-art results. In conclusion, our study answers the question "Can Transformers Forecast Vibrations?" While traditional transformer architectures show low performance in forecasting torsional resonance waves, our findings indicate that combining recurrent neural network and temporal convolutional network using the transformer architecture improves the accuracy of long-term vibration forecasting.
△ Less
Submitted 16 February, 2024;
originally announced February 2024.
-
Convergences for Minimax Optimization Problems over Infinite-Dimensional Spaces Towards Stability in Adversarial Training
Authors:
Takashi Furuya,
Satoshi Okuda,
Kazuma Suetake,
Yoshihide Sawada
Abstract:
Training neural networks that require adversarial optimization, such as generative adversarial networks (GANs) and unsupervised domain adaptations (UDAs), suffers from instability. This instability problem comes from the difficulty of the minimax optimization, and there have been various approaches in GANs and UDAs to overcome this problem. In this study, we tackle this problem theoretically throu…
▽ More
Training neural networks that require adversarial optimization, such as generative adversarial networks (GANs) and unsupervised domain adaptations (UDAs), suffers from instability. This instability problem comes from the difficulty of the minimax optimization, and there have been various approaches in GANs and UDAs to overcome this problem. In this study, we tackle this problem theoretically through a functional analysis. Specifically, we show the convergence property of the minimax problem by the gradient descent over the infinite-dimensional spaces of continuous functions and probability measures under certain conditions. Using this setting, we can discuss GANs and UDAs comprehensively, which have been studied independently. In addition, we show that the conditions necessary for the convergence property are interpreted as stabilization techniques of adversarial training such as the spectral normalization and the gradient penalty.
△ Less
Submitted 1 December, 2023;
originally announced December 2023.
-
Spike Accumulation Forwarding for Effective Training of Spiking Neural Networks
Authors:
Ryuji Saiin,
Tomoya Shirakawa,
Sota Yoshihara,
Yoshihide Sawada,
Hiroyuki Kusumoto
Abstract:
In this article, we propose a new paradigm for training spiking neural networks (SNNs), spike accumulation forwarding (SAF). It is known that SNNs are energy-efficient but difficult to train. Consequently, many researchers have proposed various methods to solve this problem, among which online training through time (OTTT) is a method that allows inferring at each time step while suppressing the me…
▽ More
In this article, we propose a new paradigm for training spiking neural networks (SNNs), spike accumulation forwarding (SAF). It is known that SNNs are energy-efficient but difficult to train. Consequently, many researchers have proposed various methods to solve this problem, among which online training through time (OTTT) is a method that allows inferring at each time step while suppressing the memory cost. However, to compute efficiently on GPUs, OTTT requires operations with spike trains and weighted summation of spike trains during forwarding. In addition, OTTT has shown a relationship with the Spike Representation, an alternative training method, though theoretical agreement with Spike Representation has yet to be proven. Our proposed method can solve these problems; namely, SAF can halve the number of operations during the forward process, and it can be theoretically proven that SAF is consistent with the Spike Representation and OTTT, respectively. Furthermore, we confirmed the above contents through experiments and showed that it is possible to reduce memory and training time while maintaining accuracy.
△ Less
Submitted 28 June, 2024; v1 submitted 4 October, 2023;
originally announced October 2023.
-
An efficient and robust estimation of spatio-temporally distributed parameters in dynamic models by an ensemble Kalman filter
Authors:
Yohei Sawada,
Le Duc
Abstract:
The accuracy of Earth system models is compromised by unknown and/or unresolved dynamics, making the quantification of systematic model errors essential. While a model parameter estimation, which allows parameters to change spatio-temporally, shows promise in quantifying and mitigating systematic model errors, the estimation of the spatio-temporally distributed model parameters has been practicall…
▽ More
The accuracy of Earth system models is compromised by unknown and/or unresolved dynamics, making the quantification of systematic model errors essential. While a model parameter estimation, which allows parameters to change spatio-temporally, shows promise in quantifying and mitigating systematic model errors, the estimation of the spatio-temporally distributed model parameters has been practically challenging. Here we present an efficient and practical method to estimate time-varying parameters in high-dimensional spaces. In our proposed method, Hybrid Offline and Online Parameter Estimation with ensemble Kalman filtering (HOOPE-EnKF), model parameters estimated by EnKF are constrained by results of offline batch optimization, in which the posterior distribution of model parameters is obtained by comparing simulated and observed climatological variables. HOOPE-EnKF outperforms the original EnKF in synthetic experiments using a two-scale Lorenz96 model and a simple global general circulation model. One advantage of HOOPE-EnKF over traditional EnKFs is that its performance is not greatly affected by inflation factors for model parameters, thus eliminating the need for extensive tuning of inflation factors. We thoroughly discuss the potential of HOOPE-EnKF as a practical method for improving parameterizations of process-based models and prediction in real-world applications such as numerical weather prediction.
△ Less
Submitted 2 October, 2023; v1 submitted 12 May, 2023;
originally announced May 2023.
-
An onset model of mutually catalytic self-replicative systems formed by an assembly of polynucleotides
Authors:
Yasuji Sawada,
Yasukazu Daigaku,
Kenji Toma
Abstract:
Self-replicability is the unique attribute observed in all the living organisms and the question how the life was physically initiated could be equivalent to the question how self-replicating informative polymers were formed in the abiotic material world. It has been suggested that the present DNA and proteins world was preceded by RNA world in which genetic information of RNA molecules was replic…
▽ More
Self-replicability is the unique attribute observed in all the living organisms and the question how the life was physically initiated could be equivalent to the question how self-replicating informative polymers were formed in the abiotic material world. It has been suggested that the present DNA and proteins world was preceded by RNA world in which genetic information of RNA molecules was replicated by the mutual catalytic function of RNA molecules. However, the important question how the transition occurred from a material world to the very early pre-RNA world remains unsolved experimentally nor theoretically. We present an onset model of mutually catalytic self-replicative systems formed in an assembly of polynucleotides. A quantitative expression of the critical condition for the onset of growing fluctuation towards self-replication in this model is obtained by analytical and numerical calculations.
△ Less
Submitted 11 April, 2023;
originally announced April 2023.
-
Bayesian Generalization Error in Linear Neural Networks with Concept Bottleneck Structure and Multitask Formulation
Authors:
Naoki Hayashi,
Yoshihide Sawada
Abstract:
Concept bottleneck model (CBM) is a ubiquitous method that can interpret neural networks using concepts. In CBM, concepts are inserted between the output layer and the last intermediate layer as observable values. This helps in understanding the reason behind the outputs generated by the neural networks: the weights corresponding to the concepts from the last hidden layer to the output layer. Howe…
▽ More
Concept bottleneck model (CBM) is a ubiquitous method that can interpret neural networks using concepts. In CBM, concepts are inserted between the output layer and the last intermediate layer as observable values. This helps in understanding the reason behind the outputs generated by the neural networks: the weights corresponding to the concepts from the last hidden layer to the output layer. However, it has not yet been possible to understand the behavior of the generalization error in CBM since a neural network is a singular statistical model in general. When the model is singular, a one to one map from the parameters to probability distributions cannot be created. This non-identifiability makes it difficult to analyze the generalization performance. In this study, we mathematically clarify the Bayesian generalization error and free energy of CBM when its architecture is three-layered linear neural networks. We also consider a multitask problem where the neural network outputs not only the original output but also the concepts. The results show that CBM drastically changes the behavior of the parameter region and the Bayesian generalization error in three-layered linear neural networks as compared with the standard version, whereas the multitask formulation does not.
△ Less
Submitted 16 March, 2023;
originally announced March 2023.
-
Spiking Synaptic Penalty: Appropriate Penalty Term for Energy-Efficient Spiking Neural Networks
Authors:
Kazuma Suetake,
Takuya Ushimaru,
Ryuji Saiin,
Yoshihide Sawada
Abstract:
Spiking neural networks (SNNs) are energy-efficient neural networks because of their spiking nature. However, as the spike firing rate of SNNs increases, the energy consumption does as well, and thus, the advantage of SNNs diminishes. Here, we tackle this problem by introducing a novel penalty term for the spiking activity into the objective function in the training phase. Our method is designed s…
▽ More
Spiking neural networks (SNNs) are energy-efficient neural networks because of their spiking nature. However, as the spike firing rate of SNNs increases, the energy consumption does as well, and thus, the advantage of SNNs diminishes. Here, we tackle this problem by introducing a novel penalty term for the spiking activity into the objective function in the training phase. Our method is designed so as to optimize the energy consumption metric directly without modifying the network architecture. Therefore, the proposed method can reduce the energy consumption more than other methods while maintaining the accuracy. We conducted experiments for image classification tasks, and the results indicate the effectiveness of the proposed method, which mitigates the dilemma of the energy--accuracy trade-off.
△ Less
Submitted 2 February, 2023;
originally announced February 2023.
-
C-SENN: Contrastive Self-Explaining Neural Network
Authors:
Yoshihide Sawada,
Keigo Nakamura
Abstract:
In this study, we use a self-explaining neural network (SENN), which learns unsupervised concepts, to acquire concepts that are easy for people to understand automatically. In concept learning, the hidden layer retains verbalizable features relevant to the output, which is crucial when adapting to real-world environments where explanations are required. However, it is known that the interpretabili…
▽ More
In this study, we use a self-explaining neural network (SENN), which learns unsupervised concepts, to acquire concepts that are easy for people to understand automatically. In concept learning, the hidden layer retains verbalizable features relevant to the output, which is crucial when adapting to real-world environments where explanations are required. However, it is known that the interpretability of concepts output by SENN is reduced in general settings, such as autonomous driving scenarios. Thus, this study combines contrastive learning with concept learning to improve the readability of concepts and the accuracy of tasks. We call this model Contrastive Self-Explaining Neural Network (C-SENN).
△ Less
Submitted 26 June, 2022; v1 submitted 20 June, 2022;
originally announced June 2022.
-
Rethinking the role of normalization and residual blocks for spiking neural networks
Authors:
Shin-ichi Ikegawa,
Ryuji Saiin,
Yoshihide Sawada,
Naotake Natori
Abstract:
Biologically inspired spiking neural networks (SNNs) are widely used to realize ultralow-power energy consumption. However, deep SNNs are not easy to train due to the excessive firing of spiking neurons in the hidden layers. To tackle this problem, we propose a novel but simple normalization technique called postsynaptic potential normalization. This normalization removes the subtraction term from…
▽ More
Biologically inspired spiking neural networks (SNNs) are widely used to realize ultralow-power energy consumption. However, deep SNNs are not easy to train due to the excessive firing of spiking neurons in the hidden layers. To tackle this problem, we propose a novel but simple normalization technique called postsynaptic potential normalization. This normalization removes the subtraction term from the standard normalization and uses the second raw moment instead of the variance as the division term. The spike firing can be controlled, enabling the training to proceed appropriating, by conducting this simple normalization to the postsynaptic potential. The experimental results show that SNNs with our normalization outperformed other models using other normalizations. Furthermore, through the pre-activation residual blocks, the proposed model can train with more than 100 layers without other special techniques dedicated to SNNs.
△ Less
Submitted 3 March, 2022;
originally announced March 2022.
-
Concept Bottleneck Model with Additional Unsupervised Concepts
Authors:
Yoshihide Sawada,
Keigo Nakamura
Abstract:
With the increasing demands for accountability, interpretability is becoming an essential capability for real-world AI applications. However, most methods utilize post-hoc approaches rather than training the interpretable model. In this article, we propose a novel interpretable model based on the concept bottleneck model (CBM). CBM uses concept labels to train an intermediate layer as the addition…
▽ More
With the increasing demands for accountability, interpretability is becoming an essential capability for real-world AI applications. However, most methods utilize post-hoc approaches rather than training the interpretable model. In this article, we propose a novel interpretable model based on the concept bottleneck model (CBM). CBM uses concept labels to train an intermediate layer as the additional visible layer. However, because the number of concept labels restricts the dimension of this layer, it is difficult to obtain high accuracy with a small number of labels. To address this issue, we integrate supervised concepts with unsupervised ones trained with self-explaining neural networks (SENNs). By seamlessly training these two types of concepts while reducing the amount of computation, we can obtain both supervised and unsupervised concepts simultaneously, even for large-sized images. We refer to the proposed model as the concept bottleneck model with additional unsupervised concepts (CBM-AUC). We experimentally confirmed that the proposed model outperformed CBM and SENN. We also visualized the saliency map of each concept and confirmed that it was consistent with the semantic meanings.
△ Less
Submitted 3 February, 2022;
originally announced February 2022.
-
S$^3$NN: Time Step Reduction of Spiking Surrogate Gradients for Training Energy Efficient Single-Step Spiking Neural Networks
Authors:
Kazuma Suetake,
Shin-ichi Ikegawa,
Ryuji Saiin,
Yoshihide Sawada
Abstract:
As the scales of neural networks increase, techniques that enable them to run with low computational cost and energy efficiency are required. From such demands, various efficient neural network paradigms, such as spiking neural networks (SNNs) or binary neural networks (BNNs), have been proposed. However, they have sticky drawbacks, such as degraded inference accuracy and latency. To solve these p…
▽ More
As the scales of neural networks increase, techniques that enable them to run with low computational cost and energy efficiency are required. From such demands, various efficient neural network paradigms, such as spiking neural networks (SNNs) or binary neural networks (BNNs), have been proposed. However, they have sticky drawbacks, such as degraded inference accuracy and latency. To solve these problems, we propose a single-step spiking neural network (S$^3$NN), an energy-efficient neural network with low computational cost and high precision. The proposed S$^3$NN processes the information between hidden layers by spikes as SNNs. Nevertheless, it has no temporal dimension so that there is no latency within training and inference phases as BNNs. Thus, the proposed S$^3$NN has a lower computational cost than SNNs that require time-series processing. However, S$^3$NN cannot adopt naïve backpropagation algorithms due to the non-differentiability nature of spikes. We deduce a suitable neuron model by reducing the surrogate gradient for multi-time step SNNs to a single-time step. We experimentally demonstrated that the obtained surrogate gradient allows S$^3$NN to be trained appropriately. We also showed that the proposed S$^3$NN could achieve comparable accuracy to full-precision networks while being highly energy-efficient.
△ Less
Submitted 2 February, 2023; v1 submitted 26 January, 2022;
originally announced January 2022.
-
An efficient estimation of time-varying parameters of dynamic models by combining offline batch optimization and online data assimilation
Authors:
Yohei Sawada
Abstract:
It is crucially important to estimate unknown parameters in earth system models by integrating observation and numerical simulation. For many applications in earth system sciences, an optimization method which allows parameters to temporally change is required. In the present paper, an efficient and practical method to estimate the time-varying parameters of relatively low dimensional models is pr…
▽ More
It is crucially important to estimate unknown parameters in earth system models by integrating observation and numerical simulation. For many applications in earth system sciences, an optimization method which allows parameters to temporally change is required. In the present paper, an efficient and practical method to estimate the time-varying parameters of relatively low dimensional models is presented. In the newly proposed method, called Hybrid Offline Online Parameter Estimation with Particle Filtering (HOOPE-PF), an inflation method to maintain the spread of ensemble members in a sampling-importance-resampling particle filter is improved using a non-parametric posterior probabilistic distribution of time-invariant parameters obtained by comparing simulated and observed climatology. The HOOPE-PF outperforms the original sampling-importance-resampling particle filter in synthetic experiments with toy models and a real-data experiment with a conceptual hydrological model especially when the ensemble size is small. The advantage of HOOPE-PF is that its performance is not greatly affected by the size of perturbation to be added to ensemble members to maintain their spread while it is critically important to get the optimal performance in the original particle filter. Since HOOPE-PF is the extension of the existing particle filter which has been extensively applied to many earth system models such as land, ecosystem, hydrology, and paleoclimate reconstruction, the HOOPE-PF can be applied to improve the simulation of these earth system models by considering time-varying model parameters.
△ Less
Submitted 2 February, 2022; v1 submitted 24 October, 2021;
originally announced October 2021.
-
Ecohydrological land reanalysis
Authors:
Yohei Sawada,
Hiroyuki Tsutsui,
Hideyuki Fujii,
Toshio Koike
Abstract:
The accurate estimation of terrestrial water and vegetation is a grand challenge in hydrometeorology. Many previous studies developed land data assimilation systems (LDASs) and provided global-scale land surface datasets by integrating numerical simulation and satellite data. However, vegetation dynamics has not been explicitly solved in these land reanalysis datasets. Here we present the newly de…
▽ More
The accurate estimation of terrestrial water and vegetation is a grand challenge in hydrometeorology. Many previous studies developed land data assimilation systems (LDASs) and provided global-scale land surface datasets by integrating numerical simulation and satellite data. However, vegetation dynamics has not been explicitly solved in these land reanalysis datasets. Here we present the newly developed land reanalysis dataset, ECoHydrological Land reAnalysis (ECHLA). ECHLA is generated by sequentially assimilating C- and X- band microwave brightness temperature satellite observations into a land surface model which can explicitly simulate the dynamic evolution of vegetation biomass. The ECHLA dataset provides semi-global soil moisture from surface to 1.95m depth, Leaf Area Index (LAI), and vegetation water content and is available from 2003 to 2010 and from 2013 to 2019. We assess the performance of ECHLA to estimate soil moisture and vegetation dynamics by comparing the ECHLA dataset with independent satellite and in-situ observation data. We found that our sequential update by data assimilation substantially improves the skill to reproduce the seasonal cycle of vegetation. Data assimilation also contributes to improving the skill to simulate soil moisture mainly in the shallow soil layers (0-0.15m depth). The ECHLA dataset will be publicly available and expected to contribute to understanding terrestrial ecohydrological cycles and water-related natural disasters such as drought.
△ Less
Submitted 15 July, 2021;
originally announced July 2021.
-
Socio-meteorology: flood prediction, social preparedness, and cry wolf effects
Authors:
Yohei Sawada,
Rin Kanai,
Hitomu Kotani
Abstract:
To improve the efficiency of flood early warning systems (FEWS), it is important to understand the interactions between natural and social systems. The high level of trust in authorities and experts is necessary to improve the likeliness of individuals to take preparedness actions responding to warnings. Despite a lot of efforts to develop the dynamic model of human and water in socio-hydrology, n…
▽ More
To improve the efficiency of flood early warning systems (FEWS), it is important to understand the interactions between natural and social systems. The high level of trust in authorities and experts is necessary to improve the likeliness of individuals to take preparedness actions responding to warnings. Despite a lot of efforts to develop the dynamic model of human and water in socio-hydrology, no socio-hydrological models explicitly simulate social collective trust in FEWS. Here we develop the stylized model to simulate the interactions of flood, social collective memory, social collective trust in FEWS, and preparedness actions responding to warnings by extending the existing socio-hydrological model. We realistically simulate the cry wolf effect, in which many false alarms undermine the credibility of the early warning systems and make it difficult to induce preparedness actions. We found (1) considering the dynamics of social collective trust in FEWS is more important in the technological society with infrequent flood events than in the green society with frequent flood events; (2) as the natural scientific skill to predict flood events is improved, the efficiency of FEWS gets more sensitive to the behavior of social collective trust, so that forecasters need to determine their warning threshold by considering the social aspects.
△ Less
Submitted 29 September, 2021; v1 submitted 23 April, 2021;
originally announced April 2021.
-
The adjacency matrices and the transition matrices related to random walks on graphs
Authors:
Tomohiro Ikkai,
Hiromichi Ohno,
Yusuke Sawada
Abstract:
A pointed graph $(Γ,v_0)$ induces a family of transition matrices in Wildberger's construction of a hermitian hypergroup via a random walk on $Γ$ starting from $v_0$. We will give a necessary condition for producing a hermitian hypergroup as we assume a weaker condition than the distance-regularity for $(Γ,v_0)$. The condition obtained in this paper connects the transition matrices and the adjacen…
▽ More
A pointed graph $(Γ,v_0)$ induces a family of transition matrices in Wildberger's construction of a hermitian hypergroup via a random walk on $Γ$ starting from $v_0$. We will give a necessary condition for producing a hermitian hypergroup as we assume a weaker condition than the distance-regularity for $(Γ,v_0)$. The condition obtained in this paper connects the transition matrices and the adjacency matrices associated with $Γ$.
△ Less
Submitted 22 December, 2020;
originally announced December 2020.
-
Hypergroup structures of open quantum random walks on distance sets
Authors:
Yusuke Sawada
Abstract:
Wildberger has introduced the method to construct a hermitian discrete hypergroup from a random walk on a graph. We will apply his method to an open quantum random walk (OQRW) on a distance set, and show that any discrete hypergroup which is not necessary hermitian is realized by an OQRW on a distance set. We will investigate distributions of OQRWs on distance sets in the view point of hypergroups…
▽ More
Wildberger has introduced the method to construct a hermitian discrete hypergroup from a random walk on a graph. We will apply his method to an open quantum random walk (OQRW) on a distance set, and show that any discrete hypergroup which is not necessary hermitian is realized by an OQRW on a distance set. We will investigate distributions of OQRWs on distance sets in the view point of hypergroups.
△ Less
Submitted 19 September, 2020;
originally announced September 2020.
-
Combining Ensemble Kalman Filter and Reservoir Computing to predict spatio-temporal chaotic systems from imperfect observations and models
Authors:
Futo Tomizawa,
Yohei Sawada
Abstract:
Prediction of spatio-temporal chaotic systems is important in various fields, such as Numerical Weather Prediction (NWP). While data assimilation methods have been applied in NWP, machine learning techniques, such as Reservoir Computing (RC), are recently recognized as promising tools to predict spatio-temporal chaotic systems. However, the sensitivity of the skill of the machine learning based pr…
▽ More
Prediction of spatio-temporal chaotic systems is important in various fields, such as Numerical Weather Prediction (NWP). While data assimilation methods have been applied in NWP, machine learning techniques, such as Reservoir Computing (RC), are recently recognized as promising tools to predict spatio-temporal chaotic systems. However, the sensitivity of the skill of the machine learning based prediction to the imperfectness of observations is unclear. In this study, we evaluate the skill of RC with noisy and sparsely distributed observations. We intensively compare the performances of RC and Local Ensemble Transform Kalman Filter (LETKF) by applying them to the prediction of the Lorenz 96 system. Although RC can successfully predict the Lorenz 96 system if the system is perfectly observed, we find that RC is vulnerable to observation sparsity compared with LETKF. To overcome this limitation of RC, we propose to combine LETKF and RC. In our proposed method, the system is predicted by RC that learned the analysis time series estimated by LETKF. Our proposed method can successfully predict the Lorenz 96 system using noisy and sparsely distributed observations. Most importantly, our method can predict better than LETKF when the process-based model is imperfect.
△ Less
Submitted 25 June, 2020;
originally announced June 2020.
-
A Thermodynamic Approach towards the Question "What is Cellular Life?"
Authors:
Yasuji Sawada,
Yasukazu Daigaku,
Kenji Toma
Abstract:
The question "What is life?" has been asked and studied by the researchers of various fields. Nevertheless, no global theory which unified various aspects of life has been proposed so far. Considering that the physical principle for the theory of birth should be the one known for the unanimated world, and that the life processes are irreversibly selective, we showed by a deductive inference that t…
▽ More
The question "What is life?" has been asked and studied by the researchers of various fields. Nevertheless, no global theory which unified various aspects of life has been proposed so far. Considering that the physical principle for the theory of birth should be the one known for the unanimated world, and that the life processes are irreversibly selective, we showed by a deductive inference that the maximum entropy production principle plays an essential role for the birth and the evolution of life in a fertile environment. In order to explain the survival strategy of life in a barren period of environment, we also proposed that life had simultaneously developed a reversible on and off switching mechanism of the chemical reactions by the dynamics of equilibrium thermodynamics. Thus, the birth and evolution of life have been achieved by the cooperation between the driving force due to the non-equilibrium thermodynamics and the protective force due to the equilibrium thermodynamics in the alternating environmental conditions.
△ Less
Submitted 20 July, 2020; v1 submitted 26 March, 2020;
originally announced March 2020.
-
Hypergroups and distance distributions of random walks on graphs
Authors:
Kenta Endo,
Ippei Mimura,
Yusuke Sawada
Abstract:
Wildberger's construction enables us to obtain a hypergroup from a special graph via random walks. We will give a probability theoretic interpretation to products on the hypergroup. The hypergroup can be identified with a commutative algebra whose basis is transition matrices. We will estimate the operator norm of such a transition matrix and clarify a relationship between their matrix products an…
▽ More
Wildberger's construction enables us to obtain a hypergroup from a special graph via random walks. We will give a probability theoretic interpretation to products on the hypergroup. The hypergroup can be identified with a commutative algebra whose basis is transition matrices. We will estimate the operator norm of such a transition matrix and clarify a relationship between their matrix products and random walks.
△ Less
Submitted 22 January, 2020;
originally announced January 2020.
-
Study of Deep Generative Models for Inorganic Chemical Compositions
Authors:
Yoshihide Sawada,
Koji Morikawa,
Mikiya Fujii
Abstract:
Generative models based on generative adversarial networks (GANs) and variational autoencoders (VAEs) have been widely studied in the fields of image generation, speech generation, and drug discovery, but, only a few studies have focused on the generation of inorganic materials. Such studies use the crystal structures of materials, but material researchers rarely store this information. Thus, we g…
▽ More
Generative models based on generative adversarial networks (GANs) and variational autoencoders (VAEs) have been widely studied in the fields of image generation, speech generation, and drug discovery, but, only a few studies have focused on the generation of inorganic materials. Such studies use the crystal structures of materials, but material researchers rarely store this information. Thus, we generate chemical compositions without using crystal information. We use a conditional VAE (CondVAE) and a conditional GAN (CondGAN) and show that CondGAN using the bag-of-atom representation with physical descriptors generates better compositions than other generative models. Also, we evaluate the effectiveness of the Metropolis-Hastings-based atomic valency modification and the extrapolation performance, which is important to material discovery.
△ Less
Submitted 24 October, 2019;
originally announced October 2019.
-
Machine learning accelerates parameter optimization and uncertainty assessment of a land surface model
Authors:
Yohei Sawada
Abstract:
The performance of land surface models (LSMs) significantly affects the understanding of atmospheric and related processes. Many of the LSMs' soil and vegetation parameters were unknown so that it is crucially important to efficiently optimize them. Here I present a globally applicable and computationally efficient method for parameter optimization and uncertainty assessment of the LSM by combinin…
▽ More
The performance of land surface models (LSMs) significantly affects the understanding of atmospheric and related processes. Many of the LSMs' soil and vegetation parameters were unknown so that it is crucially important to efficiently optimize them. Here I present a globally applicable and computationally efficient method for parameter optimization and uncertainty assessment of the LSM by combining Markov Chain Monte Carlo (MCMC) with machine learning. First, I performed the long-term (decadal scales) ensemble simulation of the LSM, in which each ensemble member has different parameters' values, and calculated the gap between simulation and observation, or the cost function, for each ensemble member. Second, I developed the statistical machine learning based surrogate model, which is computationally cheap but accurately mimics the relationship between parameters and the cost function, by applying the Gaussian process regression to learn the model simulation. Third, we applied MCMC by repeatedly driving the surrogate model to get the posterior probabilistic distribution of parameters. Using satellite passive microwave brightness temperature observations, both synthetic and real-data experiments in the Sahel region of west Africa were performed to optimize unknown soil and vegetation parameters of the LSM. The primary findings are (1) the proposed method is 50,000 times as fast as the direct application of MCMC to the full LSM; (2) the skill of the LSM to simulate both soil moisture and vegetation dynamics can be improved; (3) I successfully quantify the characteristics of equifinality by obtaining the full non-parametric probabilistic distribution of parameters.
△ Less
Submitted 16 March, 2020; v1 submitted 9 September, 2019;
originally announced September 2019.
-
Data-Driven Approach to Encoding and Decoding 3-D Crystal Structures
Authors:
Jordan Hoffmann,
Louis Maestrati,
Yoshihide Sawada,
Jian Tang,
Jean Michel Sellier,
Yoshua Bengio
Abstract:
Generative models have achieved impressive results in many domains including image and text generation. In the natural sciences, generative models have led to rapid progress in automated drug discovery. Many of the current methods focus on either 1-D or 2-D representations of typically small, drug-like molecules. However, many molecules require 3-D descriptors and exceed the chemical complexity of…
▽ More
Generative models have achieved impressive results in many domains including image and text generation. In the natural sciences, generative models have led to rapid progress in automated drug discovery. Many of the current methods focus on either 1-D or 2-D representations of typically small, drug-like molecules. However, many molecules require 3-D descriptors and exceed the chemical complexity of commonly used dataset. We present a method to encode and decode the position of atoms in 3-D molecules from a dataset of nearly 50,000 stable crystal unit cells that vary from containing 1 to over 100 atoms. We construct a smooth and continuous 3-D density representation of each crystal based on the positions of different atoms. Two different neural networks were trained on a dataset of over 120,000 three-dimensional samples of single and repeating crystal structures, made by rotating the single unit cells. The first, an Encoder-Decoder pair, constructs a compressed latent space representation of each molecule and then decodes this description into an accurate reconstruction of the input. The second network segments the resulting output into atoms and assigns each atom an atomic number. By generating compressed, continuous latent spaces representations of molecules we are able to decode random samples, interpolate between two molecules, and alter known molecules.
△ Less
Submitted 3 September, 2019;
originally announced September 2019.
-
E$_0$-semigroups and product systems of W$^*$-bimodules
Authors:
Yusuke Sawada
Abstract:
Product systems have been originally introduced to classify E$_0$-semigroups on type I factors by Arveson. We develop the classification theory of E$_0$-semigroups on a general von Neumann algebra and the dilation theory of CP$_0$-semigroups in terms of W$^*$-bimodules. For this, we provide a notion of product system of W$^*$-bimodules. This is a W$^*$-bimodule version of Arveson's and Bhat-Skeide…
▽ More
Product systems have been originally introduced to classify E$_0$-semigroups on type I factors by Arveson. We develop the classification theory of E$_0$-semigroups on a general von Neumann algebra and the dilation theory of CP$_0$-semigroups in terms of W$^*$-bimodules. For this, we provide a notion of product system of W$^*$-bimodules. This is a W$^*$-bimodule version of Arveson's and Bhat-Skeide's product systems. There exists a one-to-one correspondence between CP$_0$-semigroups and units of product systems of W$^*$-bimodules. The correspondence implies a construction of a dilation of a given CP$_0$-semigroup, a classification of E$_0$-semigroups on a von Neumann algebra up to cocycle equivalence and a relationship between Bhat-Skeide's and Muhly-Solel's constructions of minimal dilations of CP$_0$-semigroups.
△ Less
Submitted 20 April, 2019;
originally announced April 2019.
-
Disentangling Controllable and Uncontrollable Factors of Variation by Interacting with the World
Authors:
Yoshihide Sawada
Abstract:
We introduce a method to disentangle controllable and uncontrollable factors of variation by interacting with the world. Disentanglement leads to good representations and is important when applying deep neural networks (DNNs) in fields where explanations are required. This study attempts to improve an existing reinforcement learning (RL) approach to disentangle controllable and uncontrollable fact…
▽ More
We introduce a method to disentangle controllable and uncontrollable factors of variation by interacting with the world. Disentanglement leads to good representations and is important when applying deep neural networks (DNNs) in fields where explanations are required. This study attempts to improve an existing reinforcement learning (RL) approach to disentangle controllable and uncontrollable factors of variation, because the method lacks a mechanism to represent uncontrollable obstacles. To address this problem, we train two DNNs simultaneously: one that represents the controllable object and another that represents uncontrollable obstacles. For stable training, we applied a pretraining approach using a model robust against uncontrollable obstacles. Simulation experiments demonstrate that the proposed model can disentangle independently controllable and uncontrollable factors without annotated data.
△ Less
Submitted 21 May, 2018; v1 submitted 18 April, 2018;
originally announced April 2018.
-
The affine property of quasi-free states on self-dual CAR algebras
Authors:
Yusuke Sawada
Abstract:
We study conditions for which the correspondence between quasi-free states on self-dual CAR algebras and covariant operators is affine.
We study conditions for which the correspondence between quasi-free states on self-dual CAR algebras and covariant operators is affine.
△ Less
Submitted 12 July, 2018; v1 submitted 9 February, 2018;
originally announced February 2018.
-
All-Transfer Learning for Deep Neural Networks and its Application to Sepsis Classification
Authors:
Yoshihide Sawada,
Yoshikuni Sato,
Toru Nakada,
Kei Ujimoto,
Nobuhiro Hayashi
Abstract:
In this article, we propose a transfer learning method for deep neural networks (DNNs). Deep learning has been widely used in many applications. However, applying deep learning is problematic when a large amount of training data are not available. One of the conventional methods for solving this problem is transfer learning for DNNs. In the field of image recognition, state-of-the-art transfer lea…
▽ More
In this article, we propose a transfer learning method for deep neural networks (DNNs). Deep learning has been widely used in many applications. However, applying deep learning is problematic when a large amount of training data are not available. One of the conventional methods for solving this problem is transfer learning for DNNs. In the field of image recognition, state-of-the-art transfer learning methods for DNNs re-use parameters trained on source domain data except for the output layer. However, this method may result in poor classification performance when the amount of target domain data is significantly small. To address this problem, we propose a method called All-Transfer Deep Learning, which enables the transfer of all parameters of a DNN. With this method, we can compute the relationship between the source and target labels by the source domain knowledge. We applied our method to actual two-dimensional electrophoresis image~(2-DE image) classification for determining if an individual suffers from sepsis; the first attempt to apply a classification approach to 2-DE images for proteomics, which has attracted considerable attention as an extension beyond genomics. The results suggest that our proposed method outperforms conventional transfer learning methods for DNNs.
△ Less
Submitted 13 November, 2017;
originally announced November 2017.
-
A remark on the minimal dilation of the semigroup generated by a normal UCP-map
Authors:
Yusuke Sawada
Abstract:
There are known three ways to construct the minimal dilation of the discrete semigroup generated by a normal unital completely positive map on a von Neumann algebra, which are given by Arveson, Bhat-Skeide and Muhly-Solel. In this paper, we clarify the relation of the constructions by Bhat-Skeide and Muhly-Solel.
There are known three ways to construct the minimal dilation of the discrete semigroup generated by a normal unital completely positive map on a von Neumann algebra, which are given by Arveson, Bhat-Skeide and Muhly-Solel. In this paper, we clarify the relation of the constructions by Bhat-Skeide and Muhly-Solel.
△ Less
Submitted 12 July, 2018; v1 submitted 25 May, 2017;
originally announced May 2017.
-
Hypergroups derived from random walks on some infinite graphs
Authors:
Tomohiro Ikkai,
Yusuke Sawada
Abstract:
Wildberger gave a method to construct a finite hermitian discrete hypergroup from a random walk on a certain kind of graphs. In this article, we reveal that his method is applicable to a random walk on a certain kind of infinite graphs. Moreover, we make some observations of finite or infinite graphs on which a random walk produces a hermitian discrete hypergroup.
Wildberger gave a method to construct a finite hermitian discrete hypergroup from a random walk on a certain kind of graphs. In this article, we reveal that his method is applicable to a random walk on a certain kind of infinite graphs. Moreover, we make some observations of finite or infinite graphs on which a random walk produces a hermitian discrete hypergroup.
△ Less
Submitted 31 May, 2017; v1 submitted 22 May, 2017;
originally announced May 2017.
-
Notes on the bicategory of W*-bimodules
Authors:
Yusuke Sawada,
Shigeru Yamagami
Abstract:
Categories of W*-bimodules are shown in an explicit and algebraic way to constitute an involutive W*-bicategory.
Categories of W*-bimodules are shown in an explicit and algebraic way to constitute an involutive W*-bicategory.
△ Less
Submitted 13 June, 2017; v1 submitted 16 May, 2017;
originally announced May 2017.
-
Investigation of Transport Properties for FeSe$_{1-x}$Te$_x$ Thin Films under Magnetic Fields
Authors:
Yuichi Sawada,
Fuyuki Nabeshima,
Yoshinori Imai,
Atsutaka Maeda
Abstract:
We investigated the transport properties under magnetic fields of up to 9 T for FeSe$_{1-x}$Te$_x$ thin films on CaF$_2$. Measurements of the temperature dependence of the electrical resistivity revealed that for $x = 0.2 - 0.4$, where $T_{\rm c}$ is the highest, the width of the superconducting transition increased with increasing magnetic field, while the width was almost the same with increasin…
▽ More
We investigated the transport properties under magnetic fields of up to 9 T for FeSe$_{1-x}$Te$_x$ thin films on CaF$_2$. Measurements of the temperature dependence of the electrical resistivity revealed that for $x = 0.2 - 0.4$, where $T_{\rm c}$ is the highest, the width of the superconducting transition increased with increasing magnetic field, while the width was almost the same with increasing magnetic field for $x = 0 - 0.1$. In addition, the temperature dependence of the Hall coefficient drastically changed between $x = 0.1$ and $0.2$ at low temperatures. These results indicate that clear differences in the nature of the superconductivity and electronic structure exist between $x=0-0.1$ and $x \ge 0.2$.
△ Less
Submitted 3 August, 2016; v1 submitted 3 August, 2016;
originally announced August 2016.
-
Suppression of phase separation and giant enhancement of superconducting transition temperature in FeSe$_{1-x}$Te$_{x}$ thin films
Authors:
Yoshinori Imai,
Yuichi Sawada,
Fuyuki Nabeshima,
Atsutaka Maeda
Abstract:
We demonstrate the successful fabrication on CaF$_2$ substrates of FeSe$_{1-x}$Te$_{x}$ films with $0 \le x \le 1$, including the region of $0.1 \le x \le 0.4$, which is well known to be the "phase-separation region", via pulsed laser deposition which is a thermodynamically non-equilibrium method. In the resulting films, we observe a giant enhancement of the superconducting transition temperature,…
▽ More
We demonstrate the successful fabrication on CaF$_2$ substrates of FeSe$_{1-x}$Te$_{x}$ films with $0 \le x \le 1$, including the region of $0.1 \le x \le 0.4$, which is well known to be the "phase-separation region", via pulsed laser deposition which is a thermodynamically non-equilibrium method. In the resulting films, we observe a giant enhancement of the superconducting transition temperature, $T_\mathrm{c}$, in the region of $0.1 \le x \le 0.4$: the maximum value reaches 23 K, which is approximately 1.5 times as large as the values reported for bulk samples of FeSe$_{1-x}$Te$_{x}$. We present a complete phase diagram of FeSe$_{1-x}$Te$_{x}$ films. Surprisingly, a sudden suppression of $T_\mathrm{c}$ is observed at $0.1<x<0.2$, while $T_\mathrm{c}$ increases with decreasing $x$ for $0.2 \le x < 1$. Namely, there is a clear difference between superconductivity realized in $x=0-0.1$ and in $x \ge 0.2$. To obtain a film of FeSe$_{1-x}$Te$_{x}$ with high $T_\mathrm{c}$, the controls of the Te content $x$ and the in-plane lattice strain are found to be key factors.
△ Less
Submitted 3 February, 2015;
originally announced February 2015.
-
On the conflict between precision and robustness in the proportion regulation of cell types
Authors:
Ismael Rafols,
Harry K. MacWilliams,
Yasuo Maeda,
Yasuji Sawada
Abstract:
In Dictyostelium discoideum the proportion of cell types is known to be actively regulated, recovering, for example, after the removal of a given cell type. However, we have recently shown that regulation is intrinsically imprecise: it controls the proportion above/below certain upper and lower thresholds, but not within an allowed range of values that these thresholds define. To explain this find…
▽ More
In Dictyostelium discoideum the proportion of cell types is known to be actively regulated, recovering, for example, after the removal of a given cell type. However, we have recently shown that regulation is intrinsically imprecise: it controls the proportion above/below certain upper and lower thresholds, but not within an allowed range of values that these thresholds define. To explain this finding we present a model based on (i) a global negative feedback, and (ii) a cell-autonomous positive feedback leading to a hysteresis-like behaviour (i.e, a bistability of cell type). The simulated cell-type proportion is indeed found to span a range of values as a consequence of the bistability. We conclude that there is a general conflict between the precision of proportion regulation and the robustness of the differentiation of cell types.
△ Less
Submitted 30 January, 2014;
originally announced January 2014.
-
Power law fluctuation generator based on analog electrical circuit
Authors:
Aki-Hiro Sato,
Hideki Takayasu,
Yasuji Sawada
Abstract:
We constructed an analog circuit generating fluctuations of which a probability density function has power law tails. In the circuit fluctuations with an arbitrary exponent of the power law can be obtained by tuning the resistance. A theory of a differential equation with both multiplicative and additive noises which describes the circuit is introduced. The circuit is composed of a noise generat…
▽ More
We constructed an analog circuit generating fluctuations of which a probability density function has power law tails. In the circuit fluctuations with an arbitrary exponent of the power law can be obtained by tuning the resistance. A theory of a differential equation with both multiplicative and additive noises which describes the circuit is introduced. The circuit is composed of a noise generator, an analog multiplier and an integral circuit. Sequential outputs of the circuit are observed and their probability density function and autocorrelation coefficients are shown. It is found that correlation time of the autocorrelation coefficient is dependent on the power law exponent.
△ Less
Submitted 20 July, 2000;
originally announced July 2000.
-
Effect of Chaotic Noise on Multistable Systems
Authors:
Tsuyoshi Hondou,
Yasuji Sawada
Abstract:
In a recent letter [Phys.Rev.Lett. {\bf 30}, 3269 (1995), chao-dyn/9510011], we reported that a macroscopic chaotic determinism emerges in a multistable system: the unidirectional motion of a dissipative particle subject to an apparently symmetric chaotic noise occurs even if the particle is in a spatially symmetric potential. In this paper, we study the global dynamics of a dissipative particle…
▽ More
In a recent letter [Phys.Rev.Lett. {\bf 30}, 3269 (1995), chao-dyn/9510011], we reported that a macroscopic chaotic determinism emerges in a multistable system: the unidirectional motion of a dissipative particle subject to an apparently symmetric chaotic noise occurs even if the particle is in a spatially symmetric potential. In this paper, we study the global dynamics of a dissipative particle by investigating the barrier crossing probability of the particle between two basins of the multistable potential. We derive analytically an expression of the barrier crossing probability of the particle subject to a chaotic noise generated by a general piecewise linear map. We also show that the obtained analytical barrier crossing probability is applicable to a chaotic noise generated not only by a piecewise linear map with a uniform invariant density but also by a non-piecewise linear map with non-uniform invariant density. We claim, from the viewpoint of the noise induced motion in a multistable system, that chaotic noise is a first realization of the effect of {\em dynamical asymmetry} of general noise which induces the symmetry breaking dynamics.
△ Less
Submitted 8 July, 1996;
originally announced July 1996.
-
Effect of time-correlation of input patterns on the convergence of on-line learning
Authors:
Tsuyoshi Hondou,
Mitsuaki Yamamoto,
Yasuji Sawada,
Yoshihiro Hayakawa
Abstract:
We studied the effects of time correlation of subsequent patterns on the convergence of on-line learning by a feedforward neural network with backpropagation algorithm. By using chaotic time series as sequences of correlated patterns, we found that the unexpected scaling of converging time with learning parameter emerges when time-correlated patterns accelerate learning process.
We studied the effects of time correlation of subsequent patterns on the convergence of on-line learning by a feedforward neural network with backpropagation algorithm. By using chaotic time series as sequences of correlated patterns, we found that the unexpected scaling of converging time with learning parameter emerges when time-correlated patterns accelerate learning process.
△ Less
Submitted 28 June, 1996;
originally announced June 1996.
-
Comment on "White-Noise-Induced Transport in Periodic Structures"
Authors:
Tsuyoshi Hondou,
Yasuji Sawada
Abstract:
In the paper by J.Łuczka {\em et al.} ({\em Europhys. Lett.}, {\bf 31} (1995) 431), the authors reported by rigorous calculation that an additive Poissonian white shot noise can induce a macroscopic current of a dissipative particle in a periodic potential -- even {\em in the absence} of spatial asymmetry of the potential. We argue that their main result is an obvious one caused by the spatially…
▽ More
In the paper by J.Łuczka {\em et al.} ({\em Europhys. Lett.}, {\bf 31} (1995) 431), the authors reported by rigorous calculation that an additive Poissonian white shot noise can induce a macroscopic current of a dissipative particle in a periodic potential -- even {\em in the absence} of spatial asymmetry of the potential. We argue that their main result is an obvious one caused by the spatially broken symmetry of a probability distribution of the additive noise, unlike the similar result caused by chaotic noise which has a symmetric probability distribution ({\em J.Phys.Soc.Jpn.}, {\bf 63} (1994) 2014).
△ Less
Submitted 27 December, 1995; v1 submitted 22 December, 1995;
originally announced December 1995.
-
Dynamical behavior of a dissipative particle in a periodic potential subject to chaotic noise: Retrieval of chaotic determinism with broken parity
Authors:
Tsuyoshi Hondou,
Yasuji Sawada
Abstract:
Dynamical behaviors of a dissipative particle in a periodic potential subject to chaotic noise are reported. We discovered a macroscopic symmetry breaking effect of chaotic noise on a dissipative particle in a multi-stable systems emerging, even when the noise has a uniform invariant density with parity symmetry and white Fourier spectrum. The broken parity symmetry of the multi-stable potential…
▽ More
Dynamical behaviors of a dissipative particle in a periodic potential subject to chaotic noise are reported. We discovered a macroscopic symmetry breaking effect of chaotic noise on a dissipative particle in a multi-stable systems emerging, even when the noise has a uniform invariant density with parity symmetry and white Fourier spectrum. The broken parity symmetry of the multi-stable potential is not necessary for the dynamics with broken symmetry. We explain the mechanism of the symmetry breaking and estimate the average velocity of a particle under chaotic noise in terms of unstable fixed points.
△ Less
Submitted 17 October, 1995;
originally announced October 1995.
