Showing 1–34 of 34 results for author: Fu**ami, K

Commissioning of a compact multibend achromat lattice: A new 3 GeV synchrotron radiation facility

Authors: Shuhei Obara, Kota Ueshima, Takao Asaka, Yuji Hosaka, Koichi Kan, Nobuyuki Nishimori, Toshitaka Aoki, Hiroyuki Asano, Koichi Haga, Yuto Iba, Akira Ihara, Katsumasa Ito, Taiki Iwashita, Masaya Kadowaki, Rento Kanahama, Hajime Kobayashi, Hideki Kobayashi, Hideo Nishihara, Masaaki Nishikawa, Haruhiko Oikawa, Ryota Saida, Keisuke Sakuraba, Kento Sugimoto, Masahiro Suzuki, Kouki Takahashi , et al. (57 additional authors not shown)

Abstract: NanoTerasu, a new 3 GeV synchrotron light source in Japan, began user operation in April 2024. It provides high-brilliance soft to tender X-rays and covers a wide spectral range from ultraviolet to tender X-rays. Its compact storage ring with a circumference of 349 m is based on a four-bend achromat lattice to provide two straight sections in each cell for insertion devices with a natural horizont… ▽ More NanoTerasu, a new 3 GeV synchrotron light source in Japan, began user operation in April 2024. It provides high-brilliance soft to tender X-rays and covers a wide spectral range from ultraviolet to tender X-rays. Its compact storage ring with a circumference of 349 m is based on a four-bend achromat lattice to provide two straight sections in each cell for insertion devices with a natural horizontal emittance of 1.14 nm rad, which is small enough for soft X-rays users. The NanoTerasu accelerator incorporates several innovative technologies, including a full-energy injector C-band linear accelerator with a length of 110 m, an in-vacuum off-axis injection system, a four-bend achromat with B-Q combined bending magnets, and a TM020 mode accelerating cavity with built-in higher-order-mode dampers in the storage ring. This paper presents the accelerator machine commissioning over a half-year period and our model-consistent ring optics correction. The first user operation with a stored beam current of 160 mA is also reported. We summarize the storage ring parameters obtained from the commissioning. This is helpful for estimating the effective optical properties of synchrotron radiation at NanoTerasu. △ Less

Submitted 11 July, 2024; originally announced July 2024.

Comments: 30 pages, 24 figures, submitted to the journal

Phase autoencoder for limit-cycle oscillators

Authors: Koichiro Yawata, Kai Fukami, Kunihiko Taira, Hiroya Nakao

Abstract: We present a phase autoencoder that encodes the asymptotic phase of a limit-cycle oscillator, a fundamental quantity characterizing its synchronization dynamics. This autoencoder is trained in such a way that its latent variables directly represent the asymptotic phase of the oscillator. The trained autoencoder can perform two functions without relying on the mathematical model of the oscillator:… ▽ More We present a phase autoencoder that encodes the asymptotic phase of a limit-cycle oscillator, a fundamental quantity characterizing its synchronization dynamics. This autoencoder is trained in such a way that its latent variables directly represent the asymptotic phase of the oscillator. The trained autoencoder can perform two functions without relying on the mathematical model of the oscillator: first, it can evaluate the asymptotic phase and phase sensitivity function of the oscillator; second, it can reconstruct the oscillator state on the limit cycle in the original space from the phase value as an input. Using several examples of limit-cycle oscillators, we demonstrate that the asymptotic phase and phase sensitivity function can be estimated only from time-series data by the trained autoencoder. We also present a simple method for globally synchronizing two oscillators as an application of the trained autoencoder. △ Less

Submitted 28 February, 2024; originally announced March 2024.

Comments: 12 pages, 16 figures

Data-driven transient lift attenuation for extreme vortex gust-airfoil interactions

Authors: Kai Fukami, Hiroya Nakao, Kunihiko Taira

Abstract: We present a data-driven feedforward control to attenuate large transient lift experienced by an airfoil disturbed by an extreme level of discrete vortex gust. The current analysis uses a nonlinear machine-learning technique to compress the high-dimensional flow dynamics onto a low-dimensional manifold. While the interaction dynamics between the airfoil and extreme vortex gust are parameterized by… ▽ More We present a data-driven feedforward control to attenuate large transient lift experienced by an airfoil disturbed by an extreme level of discrete vortex gust. The current analysis uses a nonlinear machine-learning technique to compress the high-dimensional flow dynamics onto a low-dimensional manifold. While the interaction dynamics between the airfoil and extreme vortex gust are parameterized by its size, gust ratio, and position, the wake responses are well-captured on this simple manifold. The effect of extreme vortex disturbance about the undisturbed baseline flows can be extracted in a physically-interpretable manner. Furthermore, we call on phase-amplitude reduction to model and control the complex nonlinear extreme aerodynamic flows. The present phase-amplitude reduction model reveals the sensitivity of the dynamical system in terms of the phase shift and amplitude change induced by external forcing with respect to the baseline periodic orbit. By performing the phase-amplitude analysis for a latent dynamical model identified by sparse regression, the sensitivity functions of low-dimensionalized aerodynamic flows for both phase and amplitude are derived. With the phase and amplitude sensitivity functions, optimal forcing can be determined to quickly suppress the effect of extreme vortex gusts towards the undisturbed states in a low-order space. The present optimal flow modification built upon the machine-learned low-dimensional subspace quickly alleviates the impact of transient vortex gusts for a variety of extreme aerodynamic scenarios, providing a potential foundation for flight of small-scale air vehicles in adverse atmospheric conditions. △ Less

Submitted 10 July, 2024; v1 submitted 29 February, 2024; originally announced March 2024.

Comments: To appear in Journal of Fluid Mechanics

Data-driven nonlinear turbulent flow scaling with Buckingham Pi variables

Authors: Kai Fukami, Susumu Goto, Kunihiko Taira

Abstract: Nonlinear machine learning for turbulent flows can exhibit robust performance even outside the range of training data. This is achieved when machine-learning models can accommodate scale-invariant characteristics of turbulent flow structures. This study presents a data-driven approach to reveal scale-invariant vortical structures across Reynolds numbers that provide insights for supporting nonline… ▽ More Nonlinear machine learning for turbulent flows can exhibit robust performance even outside the range of training data. This is achieved when machine-learning models can accommodate scale-invariant characteristics of turbulent flow structures. This study presents a data-driven approach to reveal scale-invariant vortical structures across Reynolds numbers that provide insights for supporting nonlinear machine-learning-based studies of turbulent flows. To uncover conditions for which nonlinear models are likely to perform well, we use a Buckingham Pi-based sparse nonlinear scaling to find the influence of the Pi groups on the turbulent flow data. We consider nonlinear scalings of the invariants of the velocity gradient tensor for an example of three-dimensional decaying isotropic turbulence. The present scaling not only enables the identification of vortical structures that are interpolatory and extrapolatory for the given flow field data but also captures non-equilibrium effects of the energy cascade. As a demonstration, the present findings are applied to machine-learning-based super-resolution analysis of three-dimensional isotropic turbulence. We show that machine-learning models reconstruct vortical structures well in the interpolatory space with reduced performance in the extrapolatory space revealed by the nonlinearly scaled invariants. The present approach enables us to depart from labeling turbulent flow data with a single parameter of Reynolds number and comprehensively examine the flow field to support training and testing of nonlinear machine-learning techniques. △ Less

Submitted 1 March, 2024; v1 submitted 27 February, 2024; originally announced February 2024.

Comments: To appear in Journal of Fluid Mechanics

Journal ref: Journal of Fluid Mechanics, 984, R4, 2024

A cyclic perspective on transient gust encounters through the lens of persistent homology

Authors: Luke Smith, Kai Fukami, Girguis Sedky, Anya Jones, Kunihiko Taira

Abstract: Large amplitude gust encounters exhibit a range of separated flow phenomena, making them difficult to characterize using the traditional tools of aerodynamics. In this work, we propose a dynamical systems approach to gust encounters, viewing the flow as a cycle (or a closed trajectory) in state space. We posit that the topology of this cycle, or its shape and structure, provides a compact descript… ▽ More Large amplitude gust encounters exhibit a range of separated flow phenomena, making them difficult to characterize using the traditional tools of aerodynamics. In this work, we propose a dynamical systems approach to gust encounters, viewing the flow as a cycle (or a closed trajectory) in state space. We posit that the topology of this cycle, or its shape and structure, provides a compact description of the flow, and can be used to identify coordinates in which the dynamics evolve in a simple, intuitive way. To demonstrate this idea, we consider flowfield measurements of a transverse gust encounter. For each case in the dataset, we characterize the full-state dynamics of the flow using persistent homology, a tool that identifies holes in point cloud data, and transform the dynamics to a reduced-order space using a nonlinear autoencoder. Critically, we constrain the autoencoder such that it preserves topologically relevant features of the original dynamics, or those features identified by persistent homology. Using this approach, we are able to transform six separate gust encounters to a three-dimensional latent space, in which each gust encounter reduces to a simple circle, and from which the original flow can be reconstructed. This result shows that topology can guide the creation of low-dimensional state representations for strong transverse gust encounters, a crucial step toward the modeling and control of airfoil-gust interactions. △ Less

Submitted 27 June, 2023; originally announced June 2023.

Gras** Extreme Aerodynamics on a Low-Dimensional Manifold

Authors: Kai Fukami, Kunihiko Taira

Abstract: Modern air vehicles perform a wide range of operations, including transportation, defense, surveillance, and rescue. These aircraft can fly in calm conditions but avoid operations in gusty environments, encountered in urban canyons, over mountainous terrains, and in ship wakes. With extreme weather becoming ever more frequent due to global warming, it is anticipated that aircraft, especially those… ▽ More Modern air vehicles perform a wide range of operations, including transportation, defense, surveillance, and rescue. These aircraft can fly in calm conditions but avoid operations in gusty environments, encountered in urban canyons, over mountainous terrains, and in ship wakes. With extreme weather becoming ever more frequent due to global warming, it is anticipated that aircraft, especially those that are smaller in size, will encounter sizeable atmospheric disturbances and still be expected to achieve stable flight. However, there exists virtually no theoretical fluid-dynamic foundation to describe the influence of extreme vortical gusts on wings. To compound this difficulty, there is a large parameter space for gust-wing interactions. While such interactions are seemingly complex and different for each combination of gust parameters, we show that the fundamental physics behind extreme aerodynamics is far simpler and lower-rank than traditionally expected. We reveal that the nonlinear vortical flow field over time and parameter space can be compressed to only three variables with a lift-augmented autoencoder while holding the essence of the original high-dimensional physics. Extreme aerodynamic flows can be compressed through machine learning into a low-dimensional manifold, which can enable real-time sparse reconstruction, dynamical modeling, and control of extremely unsteady gusty flows. The present findings offer support for the stable flight of next-generation small air vehicles in atmosphere conditions traditionally considered unflyable. △ Less

Submitted 29 September, 2023; v1 submitted 13 May, 2023; originally announced May 2023.

Journal ref: Nature Communications, 14, 6480, 2023

Sparse sensor reconstruction of vortex-im**ed airfoil wake with machine learning

Authors: Yonghong Zhong, Kai Fukami, Byung** An, Kunihiko Taira

Abstract: Reconstruction of unsteady vortical flow fields from limited sensor measurements is challenging. We develop machine learning methods to reconstruct flow features from sparse sensor measurements during transient vortex-airfoil wake interaction using only a limited amount of training data. The present machine learning models accurately reconstruct the aerodynamic force coefficients, pressure distrib… ▽ More Reconstruction of unsteady vortical flow fields from limited sensor measurements is challenging. We develop machine learning methods to reconstruct flow features from sparse sensor measurements during transient vortex-airfoil wake interaction using only a limited amount of training data. The present machine learning models accurately reconstruct the aerodynamic force coefficients, pressure distributions over airfoil surface, and two-dimensional vorticity field for a variety of untrained cases. Multi-layer perceptron is used for estimating aerodynamic forces and pressure profiles over the surface, establishing a nonlinear model between the pressure sensor measurements and the output variables. A combination of multi-layer perceptron with convolutional neural network is utilized to reconstruct the vortical wake. Furthermore, the use of transfer learning and long short-term memory algorithm combined in the training models greatly improves the reconstruction of transient wakes by embedding the dynamics. The present machine-learning methods are able to estimate the transient flow features while exhibiting robustness against noisy sensor measurements. Finally, appropriate sensor locations over different time periods are assessed for accurately estimating the wakes. The present study offers insights into the dynamics of vortex-airfoil interaction and the development of data-driven flow estimation. △ Less

Submitted 8 May, 2023; originally announced May 2023.

Comments: To appear in Theoretical and Computational Fluid Dynamics

Super-Resolution Analysis via Machine Learning: A Survey for Fluid Flows

Authors: Kai Fukami, Koji Fukagata, Kunihiko Taira

Abstract: This paper surveys machine-learning-based super-resolution reconstruction for vortical flows. Super resolution aims to find the high-resolution flow fields from low-resolution data and is generally an approach used in image reconstruction. In addition to surveying a variety of recent super-resolution applications, we provide case studies of super-resolution analysis for an example of two-dimension… ▽ More This paper surveys machine-learning-based super-resolution reconstruction for vortical flows. Super resolution aims to find the high-resolution flow fields from low-resolution data and is generally an approach used in image reconstruction. In addition to surveying a variety of recent super-resolution applications, we provide case studies of super-resolution analysis for an example of two-dimensional decaying isotropic turbulence. We demonstrate that physics-inspired model designs enable successful reconstruction of vortical flows from spatially limited measurements. We also discuss the challenges and outlooks of machine-learning-based super-resolution analysis for fluid flow applications. The insights gained from this study can be leveraged for super-resolution analysis of numerical and experimental flow data. △ Less

Submitted 6 June, 2023; v1 submitted 25 January, 2023; originally announced January 2023.

Image and video compression of fluid flow data

Authors: Vishal Anatharaman, Jason Feldkamp, Kai Fukami, Kunihiko Taira

Abstract: We study the compression of spatial and temporal features in fluid flow data using multimedia compression techniques. The efficacy of spatial compression techniques, including JPEG and JPEG2000 (JP2), and spatio-temporal video compression techniques, namely H.264, H.265, and AV1, in limiting the introduction of compression artifacts and preserving underlying flow physics are considered for laminar… ▽ More We study the compression of spatial and temporal features in fluid flow data using multimedia compression techniques. The efficacy of spatial compression techniques, including JPEG and JPEG2000 (JP2), and spatio-temporal video compression techniques, namely H.264, H.265, and AV1, in limiting the introduction of compression artifacts and preserving underlying flow physics are considered for laminar periodic wake around a cylinder, two-dimensional turbulence, and turbulent channel flow. These compression techniques significantly compress flow data while maintaining dominant flow features with negligible error. AV1 and H.265 compressions present the best performance across a variety of canonical flow regimes and outperform traditional techniques such as proper orthogonal decomposition in some cases. These image and video compression algorithms are flexible, scalable, and generalizable holding potential for a wide range of applications in fluid dynamics in the context of data storage and transfer. △ Less

Submitted 1 February, 2023; v1 submitted 30 December, 2022; originally announced January 2023.

Assessments of epistemic uncertainty using Gaussian stochastic weight averaging for fluid-flow regression

Authors: Masaki Morimoto, Kai Fukami, Romit Maulik, Ricardo Vinuesa, Koji Fukagata

Abstract: We use Gaussian stochastic weight averaging (SWAG) to assess the model-form uncertainty associated with neural-network-based function approximation relevant to fluid flows. SWAG approximates a posterior Gaussian distribution of each weight, given training data, and a constant learning rate. Having access to this distribution, it is able to create multiple models with various combinations of sample… ▽ More We use Gaussian stochastic weight averaging (SWAG) to assess the model-form uncertainty associated with neural-network-based function approximation relevant to fluid flows. SWAG approximates a posterior Gaussian distribution of each weight, given training data, and a constant learning rate. Having access to this distribution, it is able to create multiple models with various combinations of sampled weights, which can be used to obtain ensemble predictions. The average of such an ensemble can be regarded as the `mean estimation', whereas its standard deviation can be used to construct `confidence intervals', which enable us to perform uncertainty quantification (UQ) with regard to the training process of neural networks. We utilize representative neural-network-based function approximation tasks for the following cases: (i) a two-dimensional circular-cylinder wake; (ii) the DayMET dataset (maximum daily temperature in North America); (iii) a three-dimensional square-cylinder wake; and (iv) urban flow, to assess the generalizability of the present idea for a wide range of complex datasets. SWAG-based UQ can be applied regardless of the network architecture, and therefore, we demonstrate the applicability of the method for two types of neural networks: (i) global field reconstruction from sparse sensors by combining convolutional neural network (CNN) and multi-layer perceptron (MLP); and (ii) far-field state estimation from sectional data with two-dimensional CNN. We find that SWAG can obtain physically-interpretable confidence-interval estimates from the perspective of model-form uncertainty. This capability supports its use for a wide range of problems in science and engineering. △ Less

Submitted 14 July, 2022; v1 submitted 16 September, 2021; originally announced September 2021.

Inserting machine-learned virtual wall velocity for large-eddy simulation of turbulent channel flows

Authors: Naoki Moriya, Kai Fukami, Yusuke Nabae, Masaki Morimoto, Taichi Nakamura, Koji Fukagata

Abstract: We propose a supervised-machine-learning-based wall model for coarse-grid wall-resolved large-eddy simulation (LES). Our consideration is made on LES of turbulent channel flows with a first grid point set relatively far from the wall ($\sim$ 10 wall units), while still resolving the near-wall region, to present a new path to save the computational cost. Convolutional neural network (CNN) is utiliz… ▽ More We propose a supervised-machine-learning-based wall model for coarse-grid wall-resolved large-eddy simulation (LES). Our consideration is made on LES of turbulent channel flows with a first grid point set relatively far from the wall ($\sim$ 10 wall units), while still resolving the near-wall region, to present a new path to save the computational cost. Convolutional neural network (CNN) is utilized to estimate a virtual wall-surface velocity from $x-z$ sectional fields near the wall, whose training data are generated by a direct numerical simulation (DNS) at ${\rm Re}_τ=180$. The virtual wall-surface velocity is prepared with the extrapolation of the DNS data near the wall. This idea enables us to give a proper wall condition to correct a velocity gradient near the wall. The estimation ability of the model from near wall information is first investigated as a priori test. The estimated velocity fields by the present CNN model are in statistical agreement with the reference DNS data. The model trained in a priori test is then combined with the LES as a posteriori test. We find that the LES can successfully be augmented using the present model at both the friction Reynolds number ${\rm Re}_τ=180$ used for training and the unseen Reynolds number ${\rm Re}_τ=360$ even when the first grid point is located at 5 wall units off the wall. We also investigate the robustness of the present model for the choice of sub-grid scale model and the possibility of transfer learning in a local domain. The observations through the paper suggest that the present model is a promising tool for recovering the accuracy of LES with a coarse grid near the wall. △ Less

Submitted 17 June, 2021; originally announced June 2021.

Comments: 18 pages, 14 figures

Identifying key differences between linear stochastic estimation and neural networks for fluid flow regressions

Authors: Taichi Nakamura, Kai Fukami, Koji Fukagata

Abstract: Neural networks (NNs) and linear stochastic estimation (LSE) have widely been utilized as powerful tools for fluid-flow regressions. We investigate fundamental differences between them considering two canonical fluid-flow problems: 1. the estimation of high-order proper orthogonal decomposition coefficients from low-order their counterparts for a flow around a two-dimensional cylinder, and 2. the… ▽ More Neural networks (NNs) and linear stochastic estimation (LSE) have widely been utilized as powerful tools for fluid-flow regressions. We investigate fundamental differences between them considering two canonical fluid-flow problems: 1. the estimation of high-order proper orthogonal decomposition coefficients from low-order their counterparts for a flow around a two-dimensional cylinder, and 2. the state estimation from wall characteristics in a turbulent channel flow. In the first problem, we compare the performance of LSE to that of a multi-layer perceptron (MLP). With the channel flow example, we capitalize on a convolutional neural network (CNN) as a nonlinear model which can handle high-dimensional fluid flows. For both cases, the nonlinear NNs outperform the linear methods thanks to nonlinear activation functions. We also perform error-curve analyses regarding the estimation error and the response of weights inside models. Our analysis visualizes the robustness against noisy perturbation on the error-curve domain while revealing the fundamental difference of the covered tools for fluid-flow regressions. △ Less

Submitted 18 February, 2022; v1 submitted 3 May, 2021; originally announced May 2021.

Comments: 11 pages, 9 figures

Journal ref: Scientific Reports 12, 3726 (2022)

Reconstructing three-dimensional bluff body wake from sectional flow fields with convolutional neural networks

Authors: Mitsuaki Matsuo, Kai Fukami, Taichi Nakamura, Masaki Morimoto, Koji Fukagata

Abstract: The recent development of high-performance computing enables us to generate spatio-temporal high-resolution data of nonlinear dynamical systems and to analyze them for a deeper understanding of their complex nature. This trend can be found in a wide range of science and engineering, which suggests that detailed investigations on efficient data handling in physical science must be required in the f… ▽ More The recent development of high-performance computing enables us to generate spatio-temporal high-resolution data of nonlinear dynamical systems and to analyze them for a deeper understanding of their complex nature. This trend can be found in a wide range of science and engineering, which suggests that detailed investigations on efficient data handling in physical science must be required in the future. This study considers the use of convolutional neural networks (CNNs) to achieve efficient data storage and estimation of scientific big data derived from nonlinear dynamical systems. The CNN is used to reconstruct three-dimensional data from a few numbers of two-dimensional sections in a computationally friendly manner. The present model is a combination of two- and three-dimensional CNNs, which allows users to save only some of the two-dimensional sections to reconstruct the volumetric data. As examples, we consider a flow around a square cylinder at the diameter-based Reynolds number $Re_D = 300$. We demonstrate that volumetric fluid flow data can be reconstructed with the present method from as few as five sections. Furthermore, we propose a combination of the present CNN-based reconstruction with an adaptive sampling-based super-resolution analysis to augment the data compressibility. Our report can serve as a bridge toward practical data handling for not only fluid mechanics but also a broad range of physical sciences. △ Less

Submitted 29 December, 2023; v1 submitted 16 March, 2021; originally announced March 2021.

Comments: To appear in SN Computer Science

Journal ref: SN Comput. Sci. 5, 306 (2024)

Convolutional neural networks for fluid flow analysis: toward effective metamodeling and low-dimensionalization

Authors: Masaki Morimoto, Kai Fukami, Kai Zhang, Aditya G. Nair, Koji Fukagata

Abstract: We focus on a convolutional neural network (CNN), which has recently been utilized for fluid flow analyses, from the perspective on the influence of various operations inside it by considering some canonical regression problems with fluid flow data. We consider two types of CNN-based fluid flow analyses; 1. CNN metamodeling and 2. CNN autoencoder. For the first type of CNN with additional scalar i… ▽ More We focus on a convolutional neural network (CNN), which has recently been utilized for fluid flow analyses, from the perspective on the influence of various operations inside it by considering some canonical regression problems with fluid flow data. We consider two types of CNN-based fluid flow analyses; 1. CNN metamodeling and 2. CNN autoencoder. For the first type of CNN with additional scalar inputs, which is one of the common forms of CNN for fluid flow analysis, we investigate the influence of input placements in the CNN training pipeline. As an example, estimation of force coefficients of an inclined flat plate and two side-by-side cylinders in laminar flows is considered. We find that care should be taken for the placement of additional scalar inputs depending on the problem setting and the complexity of flows that users handle. We then discuss the influence of various parameters and operations on the CNN performance, with the utilization of autoencoder (AE). A two-dimensional turbulence is considered for the demonstration of AE. The results of AE highly rely on the decaying nature. Investigation on the influence of padding operation at a convolutional layer is also performed. The zero padding shows reasonable ability compared to other methods which account for the boundary conditions assumed in the numerical data. Moreover, the effect of the dimensional reduction/extension methods inside CNN is also examined. The CNN model is robust against the difference in dimension reduction operations, while it is sensitive to the dimensional extension methods. The findings of this paper will help us better design a CNN architecture for practical fluid flow analysis △ Less

Submitted 22 July, 2021; v1 submitted 7 January, 2021; originally announced January 2021.

Comments: 24 pages, 20 figures

Global field reconstruction from sparse sensors with Voronoi tessellation-assisted deep learning

Authors: Kai Fukami, Romit Maulik, Nesar Ramachandra, Koji Fukagata, Kunihiko Taira

Abstract: Achieving accurate and robust global situational awareness of a complex time-evolving field from a limited number of sensors has been a longstanding challenge. This reconstruction problem is especially difficult when sensors are sparsely positioned in a seemingly random or unorganized manner, which is often encountered in a range of scientific and engineering problems. Moreover, these sensors can… ▽ More Achieving accurate and robust global situational awareness of a complex time-evolving field from a limited number of sensors has been a longstanding challenge. This reconstruction problem is especially difficult when sensors are sparsely positioned in a seemingly random or unorganized manner, which is often encountered in a range of scientific and engineering problems. Moreover, these sensors can be in motion and can become online or offline over time. The key leverage in addressing this scientific issue is the wealth of data accumulated from the sensors. As a solution to this problem, we propose a data-driven spatial field recovery technique founded on a structured grid-based deep-learning approach for arbitrary positioned sensors of any numbers. It should be noted that the naïve use of machine learning becomes prohibitively expensive for global field reconstruction and is furthermore not adaptable to an arbitrary number of sensors. In the present work, we consider the use of Voronoi tessellation to obtain a structured-grid representation from sensor locations enabling the computationally tractable use of convolutional neural networks. One of the central features of the present method is its compatibility with deep-learning based super-resolution reconstruction techniques for structured sensor data that are established for image processing. The proposed reconstruction technique is demonstrated for unsteady wake flow, geophysical data, and three-dimensional turbulence. The current framework is able to handle an arbitrary number of moving sensors, and thereby overcomes a major limitation with existing reconstruction methods. The presented technique opens a new pathway towards the practical use of neural networks for real-time global field estimation. △ Less

Submitted 22 July, 2021; v1 submitted 2 January, 2021; originally announced January 2021.

Probabilistic neural network-based reduced-order surrogate for fluid flows

Authors: Kai Fukami, Romit Maulik, Nesar Ramachandra, Koji Fukagata, Kunihiko Taira

Abstract: In recent years, there have been a surge in applications of neural networks (NNs) in physical sciences. Although various algorithmic advances have been proposed, there are, thus far, limited number of studies that assess the interpretability of neural networks. This has contributed to the hasty characterization of most NN methods as "black boxes" and hindering wider acceptance of more powerful mac… ▽ More In recent years, there have been a surge in applications of neural networks (NNs) in physical sciences. Although various algorithmic advances have been proposed, there are, thus far, limited number of studies that assess the interpretability of neural networks. This has contributed to the hasty characterization of most NN methods as "black boxes" and hindering wider acceptance of more powerful machine learning algorithms for physics. In an effort to address such issues in fluid flow modeling, we use a probabilistic neural network (PNN) that provide confidence intervals for its predictions in a computationally effective manner. The model is first assessed considering the estimation of proper orthogonal decomposition (POD) coefficients from local sensor measurements of solution of the shallow water equation. We find that the present model outperforms a well-known linear method with regard to estimation. This model is then applied to the estimation of the temporal evolution of POD coefficients with considering the wake of a NACA0012 airfoil with a Gurney flap and the NOAA sea surface temperature. The present model can accurately estimate the POD coefficients over time in addition to providing confidence intervals thereby quantifying the uncertainty in the output given a particular training data set. △ Less

Submitted 15 December, 2020; originally announced December 2020.

Comments: Accepted paper in Third Workshop on Machine Learning and the Physical Sciences (NeurIPS 2020)

Generalization techniques of neural networks for fluid flow estimation

Authors: Masaki Morimoto, Kai Fukami, Kai Zhang, Koji Fukagata

Abstract: We demonstrate several techniques to encourage practical uses of neural networks for fluid flow estimation. In the present paper, three perspectives which are remaining challenges for applications of machine learning to fluid dynamics are considered: 1. interpretability of machine-learned results, 2. bulking out of training data, and 3. generalizability of neural networks. For the interpretability… ▽ More We demonstrate several techniques to encourage practical uses of neural networks for fluid flow estimation. In the present paper, three perspectives which are remaining challenges for applications of machine learning to fluid dynamics are considered: 1. interpretability of machine-learned results, 2. bulking out of training data, and 3. generalizability of neural networks. For the interpretability, we first demonstrate two methods to observe the internal procedure of neural networks, i.e., visualization of hidden layers and application of gradient-weighted class activation map** (Grad-CAM), applied to canonical fluid flow estimation problems -- $(1)$ drag coefficient estimation of a cylinder wake and $(2)$ velocity estimation from particle images. It is exemplified that both approaches can successfully tell us evidences of the great capability of machine learning-based estimations. We then utilize some techniques to bulk out training data for super-resolution analysis and temporal prediction for cylinder wake and NOAA sea surface temperature data to demonstrate that sufficient training of neural networks with limited amount of training data can be achieved for fluid flow problems. The generalizability of machine learning model is also discussed by accounting for the perspectives of inter/extrapolation of training data, considering super-resolution of wakes behind two parallel cylinders. We find that various flow patterns generated by complex interaction between two cylinders can be reconstructed well, even for the test configurations regarding the distance factor. The present paper can be a significant step toward practical uses of neural networks for both laminar and turbulent flow problems. △ Less

Submitted 14 October, 2021; v1 submitted 24 November, 2020; originally announced November 2020.

Comments: 24 pages, 24 figures

Journal ref: Neural Comput. Appl. 34, 3647-3669 (2022)

Model order reduction with neural networks: Application to laminar and turbulent flows

Authors: Kai Fukami, Kazuto Hasegawa, Taichi Nakamura, Masaki Morimoto, Koji Fukagata

Abstract: We investigate the capability of neural network-based model order reduction, i.e., autoencoder (AE), for fluid flows. As an example model, an AE which comprises of a convolutional neural network and multi-layer perceptrons is considered in this study. The AE model is assessed with four canonical fluid flows, namely: (1) two-dimensional cylinder wake, (2) its transient process, (3) NOAA sea surface… ▽ More We investigate the capability of neural network-based model order reduction, i.e., autoencoder (AE), for fluid flows. As an example model, an AE which comprises of a convolutional neural network and multi-layer perceptrons is considered in this study. The AE model is assessed with four canonical fluid flows, namely: (1) two-dimensional cylinder wake, (2) its transient process, (3) NOAA sea surface temperature, and (4) $y-z$ sectional field of turbulent channel flow, in terms of a number of latent modes, a choice of nonlinear activation functions, and a number of weights contained in the AE model. We find that the AE models are sensitive against the choice of the aforementioned parameters depending on the target flows. Finally, we foresee the extensional applications and perspectives of machine learning based order reduction for numerical and experimental studies in fluid dynamics community. △ Less

Submitted 7 September, 2021; v1 submitted 20 November, 2020; originally announced November 2020.

Journal ref: SN Comput. Sci. 2, 467 (2021)

Convolutional neural network and long short-term memory based reduced order surrogate for minimal turbulent channel flow

Authors: Taichi Nakamura, Kai Fukami, Kazuto Hasegawa, Yusuke Nabae, Koji Fukagata

Abstract: We investigate the applicability of machine learning based reduced order model (ML-ROM) to three-dimensional complex flows. As an example, we consider a turbulent channel flow at the friction Reynolds number of $Re_τ=110$ in a minimum domain which can maintain coherent structures of turbulence. Training data set are prepared by direct numerical simulation (DNS). The present ML-ROM is constructed b… ▽ More We investigate the applicability of machine learning based reduced order model (ML-ROM) to three-dimensional complex flows. As an example, we consider a turbulent channel flow at the friction Reynolds number of $Re_τ=110$ in a minimum domain which can maintain coherent structures of turbulence. Training data set are prepared by direct numerical simulation (DNS). The present ML-ROM is constructed by combining a three-dimensional convolutional neural network autoencoder (CNN-AE) and a long short-term memory (LSTM). The CNN-AE works to map high-dimensional flow fields into a low-dimensional latent space. The LSTM is then utilized to predict a temporal evolution of the latent vectors obtained by the CNN-AE. The combination of CNN-AE and LSTM can represent the spatio-temporal high-dimensional dynamics of flow fields by only integrating the temporal evolution of the low-dimensional latent dynamics. The turbulent flow fields reproduced by the present ML-ROM show statistical agreement with the reference DNS data in time-ensemble sense, which can also be found through an orbit-based analysis. Influences of the population of vortical structures contained in the domain and the time interval used for temporal prediction on the ML- ROM performance are also investigated. The potential and limitation of the present ML-ROM for turbulence analysis are discussed at the end of our presentation. △ Less

Submitted 22 January, 2021; v1 submitted 26 October, 2020; originally announced October 2020.

Journal ref: Phys. Fluids 33, 025116 (2021)

Sparse identification of nonlinear dynamics with low-dimensionalized flow representations

Authors: Kai Fukami, Takaaki Murata, Kai Zhang, Koji Fukagata

Abstract: We perform a sparse identification of nonlinear dynamics (SINDy) for low-dimensionalized complex flow phenomena. We first apply the SINDy with two regression methods, the thresholded least square algorithm (TLSA) and the adaptive Lasso (Alasso) which show reasonable ability with a wide range of sparsity constant in our preliminary tests, to a two-dimensional single cylinder wake at $Re_D=100$, its… ▽ More We perform a sparse identification of nonlinear dynamics (SINDy) for low-dimensionalized complex flow phenomena. We first apply the SINDy with two regression methods, the thresholded least square algorithm (TLSA) and the adaptive Lasso (Alasso) which show reasonable ability with a wide range of sparsity constant in our preliminary tests, to a two-dimensional single cylinder wake at $Re_D=100$, its transient process, and a wake of two-parallel cylinders, as examples of high-dimensional fluid data. To handle these high dimensional data with SINDy whose library matrix is suitable for low-dimensional variable combinations, a convolutional neural network-based autoencoder (CNN-AE) is utilized. The CNN-AE is employed to map a high-dimensional dynamics into a low-dimensional latent space. The SINDy then seeks a governing equation of the mapped low-dimensional latent vector. Temporal evolution of high-dimensional dynamics can be provided by combining the predicted latent vector by SINDy with the CNN decoder which can remap the low-dimensional latent vector to the original dimension. The SINDy can provide a stable solution as the governing equation of the latent dynamics and the CNN-SINDy based modeling can reproduce high-dimensional flow fields successfully, although more terms are required to represent the transient flow and the two-parallel cylinder wake than the periodic shedding. A nine-equation turbulent shear flow model is finally considered to examine the applicability of SINDy to turbulence, although without using CNN-AE. The present results suggest that the proposed scheme with an appropriate parameter choice enables us to analyze high-dimensional nonlinear dynamics with interpretable low-dimensional manifolds. △ Less

Submitted 1 August, 2021; v1 submitted 23 October, 2020; originally announced October 2020.

Journal ref: J. Fluid Mech. 926, A10 (2021)

Convolutional neural network based hierarchical autoencoder for nonlinear mode decomposition of fluid field data

Authors: Kai Fukami, Taichi Nakamura, Koji Fukagata

Abstract: We propose a customized convolutional neural network based autoencoder called a hierarchical autoencoder, which allows us to extract nonlinear autoencoder modes of flow fields while preserving the contribution order of the latent vectors. As preliminary tests, the proposed method is first applied to a cylinder wake at $Re_D$ = 100 and its transient process. It is found that the proposed method can… ▽ More We propose a customized convolutional neural network based autoencoder called a hierarchical autoencoder, which allows us to extract nonlinear autoencoder modes of flow fields while preserving the contribution order of the latent vectors. As preliminary tests, the proposed method is first applied to a cylinder wake at $Re_D$ = 100 and its transient process. It is found that the proposed method can extract the features of these laminar flow fields as the latent vectors while kee** the order of their energy content. The present hierarchical autoencoder is further assessed with a two-dimensional $y-z$ cross-sectional velocity field of turbulent channel flow at $Re_τ$ = 180 in order to examine its applicability to turbulent flows. It is demonstrated that the turbulent flow field can be efficiently mapped into the latent space by utilizing the hierarchical model with a concept of ordered autoencoder mode family. The present results suggest that the proposed concept can be extended to meet various demands in fluid dynamics including reduced order modeling and its combination with linear theory-based methods by using its ability to arrange the order of the extracted nonlinear modes. △ Less

Submitted 19 August, 2020; v1 submitted 12 June, 2020; originally announced June 2020.

Probabilistic neural networks for fluid flow surrogate modeling and data recovery

Authors: Romit Maulik, Kai Fukami, Nesar Ramachandra, Koji Fukagata, Kunihiko Taira

Abstract: We consider the use of probabilistic neural networks for fluid flow {surrogate modeling} and data recovery. This framework is constructed by assuming that the target variables are sampled from a Gaussian distribution conditioned on the inputs. Consequently, the overall formulation sets up a procedure to predict the hyperparameters of this distribution which are then used to compute an objective fu… ▽ More We consider the use of probabilistic neural networks for fluid flow {surrogate modeling} and data recovery. This framework is constructed by assuming that the target variables are sampled from a Gaussian distribution conditioned on the inputs. Consequently, the overall formulation sets up a procedure to predict the hyperparameters of this distribution which are then used to compute an objective function given training data. We demonstrate that this framework has the ability to provide for prediction confidence intervals based on the assumption of a probabilistic posterior, given an appropriate model architecture and adequate training data. The applicability of the present framework to cases with noisy measurements and limited observations is also assessed. To demonstrate the capabilities of this framework, we consider canonical regression problems of fluid dynamics from the viewpoint of reduced-order modeling and spatial data recovery for four canonical data sets. The examples considered in this study arise from (1) the shallow water equations, (2) a two-dimensional cylinder flow, (3) the wake of NACA0012 airfoil with a Gurney flap, and (4) the NOAA sea surface temperature data set. The present results indicate that the probabilistic neural network not only produces a machine-learning-based fluid flow {surrogate} model but also systematically quantifies the uncertainty therein to assist with model interpretability. △ Less

Submitted 20 September, 2020; v1 submitted 8 May, 2020; originally announced May 2020.

Journal ref: Phys. Rev. Fluids 5, 104401 (2020)

Experimental velocity data estimation for imperfect particle images using machine learning

Authors: Masaki Morimoto, Kai Fukami, Koji Fukagata

Abstract: We propose a method using supervised machine learning to estimate velocity fields from particle images having missing regions due to experimental limitations. As a first example, a velocity field around a square cylinder at Reynolds number of ${\rm Re}_D=300$ is considered. To train machine learning models, we utilize artificial particle images (APIs) as the input data, which mimic the images of t… ▽ More We propose a method using supervised machine learning to estimate velocity fields from particle images having missing regions due to experimental limitations. As a first example, a velocity field around a square cylinder at Reynolds number of ${\rm Re}_D=300$ is considered. To train machine learning models, we utilize artificial particle images (APIs) as the input data, which mimic the images of the particle image velocimetry (PIV). The output data are the velocity fields, and the correct answers for them are given by a direct numerical simulation (DNS). We examine two types of the input data: APIs without missing regions (i.e., full APIs) and APIs with missing regions (lacked APIs). The missing regions in the lacked APIs are assumed following the exact experimental situation in our wind tunnel setup. The velocity fields estimated from both full and lacked APIs are in great agreement with the reference DNS data in terms of various statistical assessments. We further apply these machine learned models trained with the DNS data to experimental particle images so that their applicability to the exact experimental situation can be investigated. The velocity fields estimated by the machine learned models contain approximately 40 folds denser data than that with the conventional cross-correlation method. This finding suggests that we may be able to obtain finer and hidden structures of the flow field which cannot be resolved with the conventional cross-correlation method. We also found that even the complex flow structures are hidden due to the alignment of two square cylinders, the machine learned model is able to estimate the field in the missing region reasonably well. The present results indicate a great potential of the proposed machine learning based method as a new data reconstruction method for PIV. △ Less

Submitted 9 August, 2021; v1 submitted 2 May, 2020; originally announced May 2020.

Comments: 41 pages, 23 figures

Journal ref: Phys. Fluids, Vol. 33, Paper 087121 (2021)

Machine learning based spatio-temporal super resolution reconstruction of turbulent flows

Authors: Kai Fukami, Koji Fukagata, Kunihiko Taira

Abstract: We present a new turbulent data reconstruction method with supervised machine learning techniques inspired by super resolution and inbetweening, which can recover high-resolution turbulent flows from grossly coarse flow data in space and time. For the present machine learning based data reconstruction, we use the downsampled skip-connection/multi-scale model based on a convolutional neural network… ▽ More We present a new turbulent data reconstruction method with supervised machine learning techniques inspired by super resolution and inbetweening, which can recover high-resolution turbulent flows from grossly coarse flow data in space and time. For the present machine learning based data reconstruction, we use the downsampled skip-connection/multi-scale model based on a convolutional neural network to incorporate the multi-scale nature of fluid flows into its network structure. As an initial example, the model is applied to a two-dimensional cylinder wake at $Re_D$ = 100. The reconstructed flow fields by the proposed method show great agreement with the reference data obtained by direct numerical simulation. Next, we examine the capability of the proposed model for a two-dimensional decaying homogeneous isotropic turbulence. The machine-learned models can follow the decaying evolution from coarse input data in space and time, according to the assessment with the turbulence statistics. The proposed concept is further investigated for a complex turbulent channel flow over a three-dimensional domain at $Re_τ$ =180. The present model can reconstruct high-resolved turbulent flows from very coarse input data in space, and it can also reproduce the temporal evolution when the time interval is appropriately chosen. The dependence on the amount of training snapshots and duration between the first and last frames based on a temporal two-point correlation coefficient are also assessed to reveal the capability and robustness of spatio-temporal super resolution reconstruction. These results suggest that the present method can meet a range of flow reconstructions for supporting computational and experimental efforts. △ Less

Submitted 21 October, 2020; v1 submitted 24 April, 2020; originally announced April 2020.

Machine-learning-based reduced order modeling for unsteady flows around bluff bodies of various shapes

Authors: Kazuto Hasegawa, Kai Fukami, Takaaki Murata, Koji Fukagata

Abstract: We propose a method to construct a reduced order model with machine learning for unsteady flows. The present machine-learned reduced order model (ML-ROM) is constructed by combining a convolutional neural network autoencoder (CNN-AE) and a long short-term memory (LSTM), which are trained in a sequential manner. First, the CNN-AE is trained using direct numerical simulation (DNS) data so as to map… ▽ More We propose a method to construct a reduced order model with machine learning for unsteady flows. The present machine-learned reduced order model (ML-ROM) is constructed by combining a convolutional neural network autoencoder (CNN-AE) and a long short-term memory (LSTM), which are trained in a sequential manner. First, the CNN-AE is trained using direct numerical simulation (DNS) data so as to map the high-dimensional flow data into low-dimensional latent space. Then, the LSTM is utilized to establish a temporal prediction system for the low-dimensionalized vectors obtained by CNN-AE. As a test case, we consider flows around a bluff body whose shape is defined using a combination of trigonometric functions with random amplitudes. The present ML-ROMs are trained on a set of 80 bluff body shapes and tested on a different set of 20 bluff body shapes not used for training, with both training and test shapes chosen from the same random distribution. The flow fields are confirmed to be well reproduced by the present ML-ROM in terms of various statistics. We also focus on the influence of two main parameters: (1) the latent vector size in the CNN-AE, and (2) the time step size between the mapped vectors used for the LSTM. The present results show that the ML-ROM works well even for unseen shapes of bluff bodies when these parameters are properly chosen, which implies great potential for the present type of ML-ROM to be applied to more complex flows △ Less

Submitted 17 March, 2020; originally announced March 2020.

Comments: 18 pages, 20 figures

Journal ref: Theor. Comput. Fluid Dyn. 34, 367-383 (2020)

Assessment of supervised machine learning methods for fluid flows

Authors: Kai Fukami, Koji Fukagata, Kunihiko Taira

Abstract: We apply supervised machine learning techniques to a number of regression problems in fluid dynamics. Four machine learning architectures are examined in terms of their characteristics, accuracy, computational cost, and robustness for canonical flow problems. We consider the estimation of force coefficients and wakes from a limited number of sensors on the surface for flows over a cylinder and NAC… ▽ More We apply supervised machine learning techniques to a number of regression problems in fluid dynamics. Four machine learning architectures are examined in terms of their characteristics, accuracy, computational cost, and robustness for canonical flow problems. We consider the estimation of force coefficients and wakes from a limited number of sensors on the surface for flows over a cylinder and NACA0012 airfoil with a Gurney flap. The influence of the temporal density of the training data is also examined. Furthermore, we consider the use of convolutional neural network in the context of super-resolution analysis of two-dimensional cylinder wake, two-dimensional decaying isotropic turbulence, and three-dimensional turbulent channel flow. In the concluding remarks, we summarize on findings from a range of regression type problems considered herein. △ Less

Submitted 27 January, 2020; originally announced January 2020.

Reinforcement Learning with Convolutional Reservoir Computing

Authors: Hanten Chang, Katsuya Futagami

Abstract: Recently, reinforcement learning models have achieved great success, mastering complex tasks such as Go and other games with higher scores than human players. Many of these models store considerable data on the tasks and achieve high performance by extracting visual and time-series features using convolutional neural networks (CNNs) and recurrent neural networks, respectively. However, these netwo… ▽ More Recently, reinforcement learning models have achieved great success, mastering complex tasks such as Go and other games with higher scores than human players. Many of these models store considerable data on the tasks and achieve high performance by extracting visual and time-series features using convolutional neural networks (CNNs) and recurrent neural networks, respectively. However, these networks have very high computational costs because they need to be trained by repeatedly using the stored data. In this study, we propose a novel practical approach called reinforcement learning with convolutional reservoir computing (RCRC) model. The RCRC model uses a fixed random-weight CNN and a reservoir computing model to extract visual and time-series features. Using these extracted features, it decides actions with an evolution strategy method. Thereby, the RCRC model has several desirable features: (1) there is no need to train the feature extractor, (2) there is no need to store training data, (3) it can take a wide range of actions, and (4) there is only a single task-dependent weight parameter to be trained. Furthermore, we show the RCRC model can solve multiple reinforcement learning tasks with a completely identical feature extractor. △ Less

Submitted 5 December, 2019; originally announced December 2019.

Comments: arXiv admin note: substantial text overlap with arXiv:1907.08040

Convolutional Reservoir Computing for World Models

Authors: Hanten Chang, Katsuya Futagami

Abstract: Recently, reinforcement learning models have achieved great success, completing complex tasks such as mastering Go and other games with higher scores than human players. Many of these models collect considerable data on the tasks and improve accuracy by extracting visual and time-series features using convolutional neural networks (CNNs) and recurrent neural networks, respectively. However, these… ▽ More Recently, reinforcement learning models have achieved great success, completing complex tasks such as mastering Go and other games with higher scores than human players. Many of these models collect considerable data on the tasks and improve accuracy by extracting visual and time-series features using convolutional neural networks (CNNs) and recurrent neural networks, respectively. However, these networks have very high computational costs because they need to be trained by repeatedly using a large volume of past playing data. In this study, we propose a novel practical approach called reinforcement learning with convolutional reservoir computing (RCRC) model. The RCRC model has several desirable features: 1. it can extract visual and time-series features very fast because it uses random fixed-weight CNN and the reservoir computing model; 2. it does not require the training data to be stored because it extracts features without training and decides action with evolution strategy. Furthermore, the model achieves state of the art score in the popular reinforcement learning task. Incredibly, we find the random weight-fixed simple networks like only one dense layer network can also reach high score in the RL task. △ Less

Submitted 18 July, 2019; originally announced July 2019.

Nonlinear mode decomposition with convolutional neural networks for fluid dynamics

Authors: Takaaki Murata, Kai Fukami, Koji Fukagata

Abstract: We present a new nonlinear mode decomposition method to visualize the decomposed flow fields, named the mode decomposing convolutional neural network autoencoder (MD-CNN-AE). The proposed method is applied to a flow around a circular cylinder at $Re_D=100$ as a test case. The flow attributes are mapped into two modes in the latent space and then these two modes are visualized in the physical space… ▽ More We present a new nonlinear mode decomposition method to visualize the decomposed flow fields, named the mode decomposing convolutional neural network autoencoder (MD-CNN-AE). The proposed method is applied to a flow around a circular cylinder at $Re_D=100$ as a test case. The flow attributes are mapped into two modes in the latent space and then these two modes are visualized in the physical space. Because the MD-CNN-AEs with nonlinear activation functions show lower reconstruction errors than the proper orthogonal decomposition (POD), the nonlinearity contained in the activation function is considered the key to improve the capability of the model. It is found by applying POD to each field decomposed using the MD-CNN-AE with hyperbolic tangent activation that a single nonlinear MD-CNN-AE mode contains multiple orthogonal bases, in contrast to the linear methods, i.e., POD and the MD-CNN-AE with linear activation. We further assess the proposed MD-CNN-AE by applying it to a transient process of a circular cylinder wake in order to examine its capability for flows containing high-order spatial modes. The present results suggest a great potential for the nonlinear MD-CNN-AE to be used for feature extraction of flow fields in lower dimension than POD, while retaining interpretable relationships with the conventional POD modes. △ Less

Submitted 10 October, 2019; v1 submitted 7 June, 2019; originally announced June 2019.

Comments: 15 pages, 14 figures

Journal ref: J. Fluid Mech. 882, A13 (2020)

Super-resolution reconstruction of turbulent flows with machine learning

Authors: Kai Fukami, Koji Fukagata, Kunihiko Taira

Abstract: We use machine learning to perform super-resolution analysis of grossly under-resolved turbulent flow field data to reconstruct the high-resolution flow field. Two machine-learning models are developed; namely the convolutional neural network (CNN) and the hybrid Downsampled Skip-Connection Multi-Scale (DSC/MS) models. These machine-learning models are applied to two-dimensional cylinder wake as a… ▽ More We use machine learning to perform super-resolution analysis of grossly under-resolved turbulent flow field data to reconstruct the high-resolution flow field. Two machine-learning models are developed; namely the convolutional neural network (CNN) and the hybrid Downsampled Skip-Connection Multi-Scale (DSC/MS) models. These machine-learning models are applied to two-dimensional cylinder wake as a preliminary test and show remarkable ability to reconstruct laminar flow from low-resolution flow field data. We further assess the performance of these models for two-dimensional homogeneous turbulence. The CNN and DSC/MS models are found to reconstruct turbulent flows from extremely coarse flow field images with remarkable accuracy. For the turbulent flow problem, the machine-leaning based super-resolution analysis can greatly enhance the spatial resolution with as little as 50 training snapshot data, holding great potential to reveal subgrid-scale physics of complex turbulent flows. With the growing availability of flow field data from high-fidelity simulations and experiments, the present approach motivates the development of effective super-resolution models for a variety of fluid flows. △ Less

Submitted 4 February, 2019; v1 submitted 27 November, 2018; originally announced November 2018.

Comments: 14 pages, 10 figures

Journal ref: J. Fluid Mech. 870 (2019) 106-120

Synthetic turbulent inflow generator using machine learning

Authors: Kai Fukami, Yusuke Nabae, Ken Kawai, Koji Fukagata

Abstract: We propose a methodology for generating time-dependent turbulent inflow data with the aid of machine learning (ML), which has a possibility to replace conventional driver simulations or synthetic turbulent inflow generators. As for the ML model, we use an auto-encoder type convolutional neural network (CNN) with a multi-layer perceptron (MLP). For the test case, we study a fully-developed turbulen… ▽ More We propose a methodology for generating time-dependent turbulent inflow data with the aid of machine learning (ML), which has a possibility to replace conventional driver simulations or synthetic turbulent inflow generators. As for the ML model, we use an auto-encoder type convolutional neural network (CNN) with a multi-layer perceptron (MLP). For the test case, we study a fully-developed turbulent channel flow at the friction Reynolds number of ${\rm Re}_τ = 180$ for easiness of assessment. The ML models are trained using a time series of instantaneous velocity fields in a single cross-section obtained by direct numerical simulation (DNS) so as to output the cross-sectional velocity field at a specified future time instant. From the a priori test in which the output from the trained ML model are recycled to the input, the spatio-temporal evolution of cross-sectional structure is found to be reasonably well reproduced by the proposed method. The turbulence statistics obtained in the a priori test are also, in general, in reasonable agreement with the DNS data, although some deviation in the flow rate was found. It is also found that the present machine-learned inflow generator is free from the spurious periodicity, unlike the conventional driver DNS in a periodic domain. As an a posteriori test, we perform DNS of inflow-outflow turbulent channel flow with the trained ML model used as a machine-learned turbulent inflow generator (MLTG) at the inlet. It is shown that the present MLTG can maintain the turbulent channel flow for a long time period sufficient to accumulate turbulent statistics, with much lower computational cost than the corresponding driver simulation. It is also demonstrated that we can obtain accurate turbulent statistics by properly correcting the deviation in the flow rate. △ Less

Submitted 11 June, 2019; v1 submitted 22 June, 2018; originally announced June 2018.

Comments: 26 pages, 11 figures

Journal ref: Phys. Rev. Fluids 4, 064603 (2019)

Measurement of Wave Electric Fields in Plasmas by Electro-Optic Probe

Authors: M. Nishiura, Z. Yoshida, T. Mushiake, Y. Kawazura, R. Osawa, K. Fu**ami, Y. Yano, H. Saitoh, M. Yamasaki, A. Kashyap, N. Takahashi, M. Nakatsuka, A. Fukuyama

Abstract: Electric field measurement in plasmas permits quantitative comparison between the experiment and the simulation in this study. An electro-optic (EO) sensor based on Pockels effect is demonstrated to measure wave electric fields in the laboratory magnetosphere of the RT-1 device with high frequency heating sources. This system gives the merits that electric field measurements can detect electrostat… ▽ More Electric field measurement in plasmas permits quantitative comparison between the experiment and the simulation in this study. An electro-optic (EO) sensor based on Pockels effect is demonstrated to measure wave electric fields in the laboratory magnetosphere of the RT-1 device with high frequency heating sources. This system gives the merits that electric field measurements can detect electrostatic waves separated clearly from wave magnetic fields, and that the sensor head is separated electrically from strong stray fields in circumference. The electromagnetic waves are excited at the double loop antenna for ion heating in electron cyclotron heated plasmas. In the air, the measured wave electric fields are in good absolute agreement with those predicted by the TASK/WF2 code. In inhomogeneous plasmas, the wave electric fields in the peripheral region are enhanced compared with the simulated electric fields. The potential oscillation of the antenna is one of the possible reason to explain the experimental results qualitatively. △ Less

Submitted 26 August, 2016; originally announced August 2016.

Comments: submitted to Review of Scientific Instruments

Realization of features of immune response by dynamical system models and a possible mechanism of memory of antigen invasion

Authors: Mika Yoshida, Kinji Fuchikami, Tatsuya Uezu

Abstract: Among features of real immune responses which occur when antigens invade a body,there are two remarkable features. One is that the amount of antibodies produced in the secondary invasion by the same antigens is more than 10 times larger than that in the primary invasion. The other is that more effective antibodies which can neutralize the antigens more quickly are produced by somatic hypermutati… ▽ More Among features of real immune responses which occur when antigens invade a body,there are two remarkable features. One is that the amount of antibodies produced in the secondary invasion by the same antigens is more than 10 times larger than that in the primary invasion. The other is that more effective antibodies which can neutralize the antigens more quickly are produced by somatic hypermutation during the immune response. This phenomenon is named as 'affinity maturation'. In this paper, we try to reproduce these features by dynamical system models and present possible factors to realize them. Further, we present a model in which the memory of the invasion by antigens is realized without immune memory cells. △ Less

Submitted 6 February, 2006; originally announced February 2006.

Comments: 17 pages, 11 figures

Timing System of SPring-8 Booster Synchrotron

Authors: N. Hosoda, T. Ohshima, T. Aoki, T. Asaka, H. Ego, K. Fukami, Y. Kawashima, Y. Ohashi, T. Takashima, H. Yonehara

Abstract: The timing system of SPring-8 booster synchrotron generates various timing signals concerning beam injection, acceleration from 1 GeV to 8 GeV and ejection. We have improved the timing system of the synchrotron giving it better stability and flexibility. This improvement results the other merits of advanced operations, for example, storing electron beam in the synchrotron, changing the injection… ▽ More The timing system of SPring-8 booster synchrotron generates various timing signals concerning beam injection, acceleration from 1 GeV to 8 GeV and ejection. We have improved the timing system of the synchrotron giving it better stability and flexibility. This improvement results the other merits of advanced operations, for example, storing electron beam in the synchrotron, changing the injection cycle from 1 Hz to the slower frequency to increase the RF knock-out (RF-KO) operation period and ejecting the low energy beam during ram** up. △ Less

Submitted 10 December, 2001; v1 submitted 11 November, 2001; originally announced November 2001.

Comments: International Conference on Accelerator and Large Experimental Physics Control Systems San Jose, California, November 27-30, 2001, (TUAP046), 3 pages, PDF genarated by MS-Word2000 on Windows98

Journal ref: eConf C011127 (2001) TUAP046