-
Physics-guided Design and Learning of Neural Networks for Predicting Drag Force on Particle Suspensions in Moving Fluids
Authors:
Nikhil Muralidhar,
Jie Bu,
Ze Cao,
Long He,
Naren Ramakrishnan,
Danesh Tafti,
Anuj Karpatne
Abstract:
Physics-based simulations are often used to model and understand complex physical systems and processes in domains like fluid dynamics. Such simulations, although used frequently, have many limitations which could arise either due to the inability to accurately model a physical process owing to incomplete knowledge about certain facets of the process or due to the underlying process being too comp…
▽ More
Physics-based simulations are often used to model and understand complex physical systems and processes in domains like fluid dynamics. Such simulations, although used frequently, have many limitations which could arise either due to the inability to accurately model a physical process owing to incomplete knowledge about certain facets of the process or due to the underlying process being too complex to accurately encode into a simulation model. In such situations, it is often useful to rely on machine learning methods to fill in the gap by learning a model of the complex physical process directly from simulation data. However, as data generation through simulations is costly, we need to develop models, being cognizant of data paucity issues. In such scenarios it is often helpful if the rich physical knowledge of the application domain is incorporated in the architectural design of machine learning models. Further, we can also use information from physics-based simulations to guide the learning process using aggregate supervision to favorably constrain the learning process. In this paper, we propose PhyDNN, a deep learning model using physics-guided structural priors and physics-guided aggregate supervision for modeling the drag forces acting on each particle in a Computational Fluid Dynamics-Discrete Element Method(CFD-DEM). We conduct extensive experiments in the context of drag force prediction and showcase the usefulness of including physics knowledge in our deep learning formulation both in the design and through learning process. Our proposed PhyDNN model has been compared to several state-of-the-art models and achieves a significant performance improvement of 8.46% on average across all baseline models. The source code has been made available and the dataset used is detailed in [1, 2].
△ Less
Submitted 5 November, 2019;
originally announced November 2019.
-
Bounded linear operators in PN-spaces
Authors:
Delavar Varasteh Tafti,
Mahdi Azhini
Abstract:
In this paper, first we present a new useful way of formulating probabilistic normed spaces. Then by using this formulation and probabilistic normed space version of the Baire category theorem, we prove four important results of functional analysis, i.e. the open map**, closed graph, principle of uniform boundedness and Banach-Steinhaus theorem in PN-spaces.
In this paper, first we present a new useful way of formulating probabilistic normed spaces. Then by using this formulation and probabilistic normed space version of the Baire category theorem, we prove four important results of functional analysis, i.e. the open map**, closed graph, principle of uniform boundedness and Banach-Steinhaus theorem in PN-spaces.
△ Less
Submitted 8 July, 2018;
originally announced July 2018.
-
Completeness in Probabilistic Metric Spaces
Authors:
Delavar Varasteh Tafti,
Mahdi Azhini
Abstract:
In this paper, we present the Cantor Intersection Theorem and a formulation of Baire Theorem in complete PM spaces. In addition, the Heine-Borel property for PM spaces is considered in detail.
In this paper, we present the Cantor Intersection Theorem and a formulation of Baire Theorem in complete PM spaces. In addition, the Heine-Borel property for PM spaces is considered in detail.
△ Less
Submitted 14 January, 2018;
originally announced January 2018.
-
Recycling Krylov subspaces for CFD applications and a new hybrid recycling solver
Authors:
Amit Amritkar,
Eric de Sturler,
Katarzyna Ćwirydowicz,
Danesh Tafti,
Kapil Ahuja
Abstract:
We focus on robust and efficient iterative solvers for the pressure Poisson equation in incompressible Navier-Stokes problems. Preconditioned Krylov subspace methods are popular for these problems, with BiCGStab and GMRES(m) most frequently used for nonsymmetric systems. BiCGStab is popular because it has cheap iterations, but it may fail for stiff problems, especially early on as the initial gues…
▽ More
We focus on robust and efficient iterative solvers for the pressure Poisson equation in incompressible Navier-Stokes problems. Preconditioned Krylov subspace methods are popular for these problems, with BiCGStab and GMRES(m) most frequently used for nonsymmetric systems. BiCGStab is popular because it has cheap iterations, but it may fail for stiff problems, especially early on as the initial guess is far from the solution. Restarted GMRES is better, more robust, in this phase, but restarting may lead to very slow convergence. Therefore, we evaluate the rGCROT method for these systems. This method recycles a selected subspace of the search space (called recycle space) after a restart. This generally improves the convergence drastically compared with GMRES(m). Recycling subspaces is also advantageous for subsequent linear systems, if the matrix changes slowly or is constant. However, rGCROT iterations are still expensive in memory and computation time compared with those of BiCGStab. Hence, we propose a new, hybrid approach that combines the cheap iterations of BiCGStab with the robustness of rGCROT. For the first few time steps the algorithm uses rGCROT and builds an effective recycle space, and then it recycles that space in the rBiCGStab solver. We evaluate rGCROT on a turbulent channel flow problem, and we evaluate both rGCROT and the new, hybrid combination of rGCROT and rBiCGStab on a porous medium flow problem. We see substantial performance gains on both problems.
△ Less
Submitted 25 September, 2015; v1 submitted 1 January, 2015;
originally announced January 2015.
-
A unified formulation of Gaussian vs. sparse stochastic processes - Part II: Discrete-domain theory
Authors:
Michael Unser,
Pouya D. Tafti,
Arash Amini,
Hagai Kirshner
Abstract:
This paper is devoted to the characterization of an extended family of CARMA (continuous-time autoregressive moving average) processes that are solutions of stochastic differential equations driven by white Levy innovations. These are completely specified by: (1) a set of poles and zeros that fixes their correlation structure, and (2) a canonical infinitely-divisible probability distribution that…
▽ More
This paper is devoted to the characterization of an extended family of CARMA (continuous-time autoregressive moving average) processes that are solutions of stochastic differential equations driven by white Levy innovations. These are completely specified by: (1) a set of poles and zeros that fixes their correlation structure, and (2) a canonical infinitely-divisible probability distribution that controls their degree of sparsity (with the Gaussian model corresponding to the least sparse scenario). The generalized CARMA processes are either stationary or non-stationary, depending on the location of the poles in the complex plane. The most basic non-stationary representatives (with a single pole at the origin) are the Levy processes, which are the non-Gaussian counterparts of Brownian motion. We focus on the general analog-to-discrete conversion problem and introduce a novel spline-based formalism that greatly simplifies the derivation of the correlation properties and joint probability distributions of the discrete versions of these processes. We also rely on the concept of generalized increment process, which suppresses all long range dependencies, to specify an equivalent discrete-domain innovation model. A crucial ingredient is the existence of a minimally-supported function associated with the whitening operator L; this B-spline, which is fundamental to our formulation, appears in most of our formulas, both at the level of the correlation and the characteristic function. We make use of these discrete-domain results to numerically generate illustrative examples of sparse signals that are consistent with the continuous-domain model.
△ Less
Submitted 5 October, 2012; v1 submitted 31 August, 2011;
originally announced August 2011.
-
A unified formulation of Gaussian vs. sparse stochastic processes - Part I: Continuous-domain theory
Authors:
Michael Unser,
Pouya D. Tafti,
Qiyu Sun
Abstract:
We introduce a general distributional framework that results in a unifying description and characterization of a rich variety of continuous-time stochastic processes. The cornerstone of our approach is an innovation model that is driven by some generalized white noise process, which may be Gaussian or not (e.g., Laplace, impulsive Poisson or alpha stable). This allows for a conceptual decoupling b…
▽ More
We introduce a general distributional framework that results in a unifying description and characterization of a rich variety of continuous-time stochastic processes. The cornerstone of our approach is an innovation model that is driven by some generalized white noise process, which may be Gaussian or not (e.g., Laplace, impulsive Poisson or alpha stable). This allows for a conceptual decoupling between the correlation properties of the process, which are imposed by the whitening operator L, and its sparsity pattern which is determined by the type of noise excitation. The latter is fully specified by a Levy measure. We show that the range of admissible innovation behavior varies between the purely Gaussian and super-sparse extremes. We prove that the corresponding generalized stochastic processes are well-defined mathematically provided that the (adjoint) inverse of the whitening operator satisfies some Lp bound for p>=1. We present a novel operator-based method that yields an explicit characterization of all Levy-driven processes that are solutions of constant-coefficient stochastic differential equations. When the underlying system is stable, we recover the family of stationary CARMA processes, including the Gaussian ones. The approach remains valid when the system is unstable and leads to the identification of potentially useful generalizations of the Levy processes, which are sparse and non-stationary. Finally, we show how we can apply finite difference operators to obtain a stationary characterization of these processes that is maximally decoupled and stable, irrespective of the location of the poles in the complex plane.
△ Less
Submitted 5 October, 2012; v1 submitted 31 August, 2011;
originally announced August 2011.