-
FSEI-GPU: GPU accelerated simulations of the fluid-structure-electrophysiology interaction in the left heart
Authors:
Francesco Viola,
Vamsi Spandan,
Valentina Meschini,
Joshua Romero,
Massimiliano Fatica,
Marco D. de Tullio,
Roberto Verzicco
Abstract:
The reliability of cardiovascular computational models depends on the accurate solution of the hemodynamics, the realistic characterization of the hyperelastic and electric properties of the tissues along with the correct description of their interaction. The resulting fluid-structure-electrophysiology interaction (FSEI) thus requires an immense computational power, usually available in large supe…
▽ More
The reliability of cardiovascular computational models depends on the accurate solution of the hemodynamics, the realistic characterization of the hyperelastic and electric properties of the tissues along with the correct description of their interaction. The resulting fluid-structure-electrophysiology interaction (FSEI) thus requires an immense computational power, usually available in large supercomputing centers, and requires long time to obtain results even if multi-CPU processors are used (MPI acceleration). In recent years, graphics processing units (GPUs) have emerged as a convenient platform for high performance computing, as they allow for considerable reductions of the time-to-solution. This approach is particularly appealing if the tool has to support medical decisions that require solutions within reduced times and possibly obtained by local computational resources. Accordingly, our multi-physics solver has been ported to GPU architectures using CUDA Fortran to tackle fast and accurate hemodynamics simulations of the human heart without resorting to large-scale supercomputers. This work describes the use of CUDA to accelerate the FSEI on heterogeneous clusters, where both the CPUs and GPUs are used in synergistically with minor modifications of the original source code. The resulting GPU accelerated code solves a single heartbeat within a few hours (from three to ten depending on the grid resolution) running on premises computing facility made of few GPU cards, which can be easily installed in a medical laboratory or in a hospital, thus opening towards a systematic computational fluid dynamics (CFD) aided diagnostic.
△ Less
Submitted 4 May, 2021; v1 submitted 28 March, 2021;
originally announced March 2021.
-
Non-universal transport mechanisms in vertical natural convection with dispersed light droplets
Authors:
Chong Shen Ng,
Vamsi Spandan,
Roberto Verzicco,
Detlef Lohse
Abstract:
We present results on the effect of dispersed droplets in vertical natural convection (VC) using direct numerical simulations based on a two-way fully coupled Euler-Lagrange approach with a liquid phase and a dispersed droplets phase. For increasing thermal driving, characterised by the Rayleigh number, $Ra$, of the two analysed droplet volume fractions, $α= 5\times10^{-3}$ and…
▽ More
We present results on the effect of dispersed droplets in vertical natural convection (VC) using direct numerical simulations based on a two-way fully coupled Euler-Lagrange approach with a liquid phase and a dispersed droplets phase. For increasing thermal driving, characterised by the Rayleigh number, $Ra$, of the two analysed droplet volume fractions, $α= 5\times10^{-3}$ and $α= 2\times 10^{-2}$, we find non-monotonic responses to the overall heat fluxes, characterised by the Nusselt number, $Nu$. The $Nu$ number is larger when the droplets are thermally coupled to the liquid. However, $Nu$ retains the effective scaling exponents that are close to the ${1/4}$-laminar VC scaling, suggesting that the heat transport is still modulated by thermal boundary layers. Local analyses reveal the non-monotonic trends of local heat fluxes and wall-shear stresses: Whilst regions of high heat fluxes are correlated to increased wall-shear stresses, the spatio-temporal distribution and magnitude of the increase is non-universal, implying that the overall heat transport is obscured by competing mechanisms. Most crucially, we find that the transport mechanisms inherently depend on the dominance of droplet driving to thermal driving that can quantified by (i) the bubblance parameter $b$, which measures the ratio of energy produced by the dispersed phase and the energy of the background turbulence, and (ii) $Ra_d/Ra$, where $Ra_d$ is the droplet Rayleigh number, which we introduce in this paper. When $b \lesssim O(10^{-1})$ and $Ra_d/Ra \lesssim O(100)$, the $Nu$ scaling is expected to recover to the VC scaling without droplets, and comparison with $b$ and $Ra_d/Ra$ from our data supports this notion.
△ Less
Submitted 19 November, 2019;
originally announced November 2019.
-
Flow induced dissolution of femtoliter surface droplet arrays
Authors:
Lei Bao,
Vamsi Spandan,
Yantao Yang,
Brendan Dyetta,
Roberto Verziccod,
Detlef Lohseb,
Xuehua Zhang
Abstract:
The dissolution of liquid nanodroplets is a crucial step in many applied processes, such as separation and dispersion in food industry, crystal formation of pharmaceutical products, concentrating and analysis in medical diagnosis, and drug delivery in aerosols. In this work, using both experiments and numerical simulations, we \textit{quantitatively} study the dissolution dynamics of femtoliter su…
▽ More
The dissolution of liquid nanodroplets is a crucial step in many applied processes, such as separation and dispersion in food industry, crystal formation of pharmaceutical products, concentrating and analysis in medical diagnosis, and drug delivery in aerosols. In this work, using both experiments and numerical simulations, we \textit{quantitatively} study the dissolution dynamics of femtoliter surface droplets in a highly ordered array under a uniform flow. Our results show that the dissolution of femoliter droplets strongly depends on their spatial positions relative to the flow direction, drop-to-drop spacing in the array, and the imposed flow rate. In some particular case, the droplet at the edge of the array can dissolve about 30% faster than the ones located near the centre. The dissolution rate of the droplet increases by 60% as the inter-droplet spacing is increased from 2.5 $μ$m to 20 $μ$m. Moreover, the droplets close to the front of flow commence to shrink earlier than those droplets in the center of the array. The average dissolution rate is faster for faster flow. As a result, the dissolution time $T_{i}$ decreases with the Reynolds number Re of the flow as $T_{i}\propto Re^{-3/4}$. The experimental results are in good agreement with numerical simulations where the advection-diffusion equation for the concentration field is solved and the concentration gradient on the surface of the drop is computed. The findings suggest potential approaches to manipulate nanodroplet sizes in droplet arrays simply by dissolution controlled by an external flow. The obtained droplets with varying curvatures may serve as templates for generating multifocal microlens in one array.
△ Less
Submitted 6 September, 2022; v1 submitted 7 June, 2018;
originally announced June 2018.
-
Physical mechanisms governing drag reduction in turbulent Taylor-Couette flow with finite-size deformable bubbles
Authors:
Vamsi Spandan,
Roberto Verzicco,
Detlef Lohse
Abstract:
The phenomenon of drag reduction induced by injection of bubbles into a turbulent carrier fluid has been known for a long time; the governing control parameters and underlying physics is however not well understood. In this paper, we use three dimensional numerical simulations to uncover the effect of deformability of bubbles injected in a turbulent Taylor-Couette flow on the overall drag experien…
▽ More
The phenomenon of drag reduction induced by injection of bubbles into a turbulent carrier fluid has been known for a long time; the governing control parameters and underlying physics is however not well understood. In this paper, we use three dimensional numerical simulations to uncover the effect of deformability of bubbles injected in a turbulent Taylor-Couette flow on the overall drag experienced by the system. We consider two different Reynolds numbers for the carrier flow, i.e. $Re_i=5\times 10^3$ and $Re_i=2\times 10^4$; the deformability of the bubbles is controlled through the Weber number which is varied in the range $We=0.01 - 2.0$. Our numerical simulations show that increasing the deformability of bubbles i.e., $We$ leads to an increase in drag reduction. We look at the different physical effects contributing to drag reduction and analyse their individual contributions with increasing bubble deformability. Profiles of local angular velocity flux show that in the presence of bubbles, turbulence is enhanced near the inner cylinder while attenuated in the bulk and near the outer cylinder. We connect the increase in drag reduction to the decrease in dissipation in the wake of highly deformed bubbles near the inner cylinder.
△ Less
Submitted 10 May, 2018;
originally announced May 2018.
-
A fast moving least squares approximation with adaptive Lagrangian mesh refinement for large scale immersed boundary simulations
Authors:
Vamsi Spandan,
Detlef Lohse,
Marco D. de Tullio,
Roberto Verzicco
Abstract:
In this paper we propose and test the validity of simple and easy-to-implement algorithms within the immersed boundary framework geared towards large scale simulations involving thousands of deformable bodies in highly turbulent flows. First, we introduce a fast moving least squares (fast-MLS) approximation technique with which we speed up the process of building transfer functions during the simu…
▽ More
In this paper we propose and test the validity of simple and easy-to-implement algorithms within the immersed boundary framework geared towards large scale simulations involving thousands of deformable bodies in highly turbulent flows. First, we introduce a fast moving least squares (fast-MLS) approximation technique with which we speed up the process of building transfer functions during the simulations which leads to considerable reductions in computational time. We compare the accuracy of the fast-MLS against the exact moving least squares (MLS) for the standard problem of uniform flow over a sphere. In order to overcome the restrictions set by the resolution coupling of the Lagrangian and Eulerian meshes in this particular immersed boundary method, we present an adaptive Lagrangian mesh refinement procedure that is capable of drastically reducing the number of required nodes of the basic Lagrangian mesh when the immersed boundaries can move and deform. Finally, a coarse-grained collision detection algorithm is presented which can detect collision events between several Lagrangian markers residing on separate complex geometries with minimal computational overhead.
△ Less
Submitted 3 May, 2018;
originally announced May 2018.
-
Fluctuation-induced forces in homogeneous isotropic turbulence
Authors:
Vamsi Spandan,
Daniel Putt,
Rodolfo Ostilla-Mónico,
Alpha Albert Lee
Abstract:
Understanding force generation in non-equilibrium systems is a significant challenge in statistical physics. We uncover a surprising fluctuation-induced force between two plates immersed in homogeneous isotropic turbulence using Direct Numerical Simulation. The force is a non-monotonic function of plate separation. The mechanism of force generation reveals an intriguing analogy with fluctuation-in…
▽ More
Understanding force generation in non-equilibrium systems is a significant challenge in statistical physics. We uncover a surprising fluctuation-induced force between two plates immersed in homogeneous isotropic turbulence using Direct Numerical Simulation. The force is a non-monotonic function of plate separation. The mechanism of force generation reveals an intriguing analogy with fluctuation-induced forces: energy in the fluid is localised in regions of high vorticity, or "worms", which have a characteristic length scale. The magnitude of the force depends on the packing of worms inside the plates, with the maximal force attained when the plate separation is comparable to the characteristic worm length. A key implication of our study is that the length scale-dependent partition of energy in an active or non-equilibrium system determines force generation.
△ Less
Submitted 17 November, 2018; v1 submitted 2 May, 2018;
originally announced May 2018.
-
Deformable ellipsoidal bubbles in Taylor-Couette flow with enhanced Euler-Lagrange tracking
Authors:
Vamsi Spandan,
Roberto Verzicco,
Detlef Lohse
Abstract:
In this work we present numerical simulations of $10^5$ sub-Kolmogorov deformable bubbles dispersed in Taylor-Couette flow (a wall-bounded shear system) with rotating inner cylinder and outer cylinder at rest. We study the effect of deformability of the bubbles on the overall drag induced by the carrier fluid in the two-phase system. We find that an increase in deformability of the bubbles results…
▽ More
In this work we present numerical simulations of $10^5$ sub-Kolmogorov deformable bubbles dispersed in Taylor-Couette flow (a wall-bounded shear system) with rotating inner cylinder and outer cylinder at rest. We study the effect of deformability of the bubbles on the overall drag induced by the carrier fluid in the two-phase system. We find that an increase in deformability of the bubbles results in enhanced drag reduction due to a more pronounced accumulation of the deformed bubbles near the driving inner wall. This preferential accumulation is induced by an increase in the resistance on the motion of the bubbles in the wall-normal direction. The increased resistance is linked to the strong deformation of the bubbles near the wall which makes them prolate (stretched along one axes) and orient along the stream-wise direction. A larger concentration of the bubbles near the driving wall implies that they are more effective in weakening the plume ejections which results in stronger drag reduction effects. These simulations which are practically impossible with fully resolved techniques are made possible by coupling a sub-grid deformation model with two-way coupled Euler-Lagrangian tracking of sub-Kolmogorov bubbles dispersed in a turbulent flow field which is solved through direct numerical simulations. The bubbles are considered to be ellipsoidal in shape and their deformation is governed by an evolution equation which depends on the local flow conditions and their surface tension.
△ Less
Submitted 3 August, 2017;
originally announced August 2017.
-
AFiD-GPU: a versatile Navier-Stokes Solver for Wall-Bounded Turbulent Flows on GPU Clusters
Authors:
Xiaojue Zhu,
Everett Phillips,
Vamsi Spandan,
John Donners,
Gregory Ruetsch,
Josh Romero,
Rodolfo Ostilla-Mónico,
Yantao Yang,
Detlef Lohse,
Roberto Verzicco,
Massimiliano Fatica,
Richard J. A. M. Stevens
Abstract:
The AFiD code, an open source solver for the incompressible Navier-Stokes equations ({\color{blue}\burl{http://www.afid.eu}}), has been ported to GPU clusters to tackle large-scale wall-bounded turbulent flow simulations. The GPU porting has been carried out in CUDA Fortran with the extensive use of kernel loop directives (CUF kernels) in order to have a source code as close as possible to the ori…
▽ More
The AFiD code, an open source solver for the incompressible Navier-Stokes equations ({\color{blue}\burl{http://www.afid.eu}}), has been ported to GPU clusters to tackle large-scale wall-bounded turbulent flow simulations. The GPU porting has been carried out in CUDA Fortran with the extensive use of kernel loop directives (CUF kernels) in order to have a source code as close as possible to the original CPU version; just a few routines have been manually rewritten. A new transpose scheme, which is not limited to the GPU version only and can be generally applied to any CFD code that uses pencil distributed parallelization, has been devised to improve the scaling of the Poisson solver, the main bottleneck of incompressible solvers. The GPU version can reduce the wall clock time by an order of magnitude compared to the CPU version for large meshes. Due to the increased performance and efficient use of memory, the GPU version of AFiD can perform simulations in parameter ranges that are unprecedented in thermally-driven wall-bounded turbulence. To verify the accuracy of the code, turbulent Rayleigh-Bénard convection and plane Couette flow are simulated and the results are in good agreement with the experimental and computational data that published in previous literatures.
△ Less
Submitted 3 May, 2017;
originally announced May 2017.
-
Life stages of wall-bounded decay of Taylor-Couette turbulence
Authors:
Rodolfo Ostilla-Mónico,
Xiaojue Zhu,
Vamsi Spandan,
Roberto Verzicco,
Detlef Lohse
Abstract:
The decay of Taylor-Couette turbulence, i.e~the flow between two coaxial and independently rotating cylinders, is numerically studied by instantaneously stop** the forcing from an initially statistically stationary flow field at a Reynolds number of $Re=3.5\times 10^4$. The effect of wall-friction is analysed by comparing three separate cases, in which the cylinders are either suddenly made no-s…
▽ More
The decay of Taylor-Couette turbulence, i.e~the flow between two coaxial and independently rotating cylinders, is numerically studied by instantaneously stop** the forcing from an initially statistically stationary flow field at a Reynolds number of $Re=3.5\times 10^4$. The effect of wall-friction is analysed by comparing three separate cases, in which the cylinders are either suddenly made no-slip or stress-free. Different life stages are observed during the decay. In the first stage, the decay is dominated by large-scale rolls. Counterintuitively, when these rolls fade away, if the flow inertia is small a redistribution of energy occurs, the energy of the azimuthal velocity behaves non-monotonically: first decreasing by almost two orders of magnitude, and then increasing during the redistribution. The second stage is dominated by non-normal transient growth of perturbations in the axial (spanwise) direction. Once this mechanism is exhausted, the flow enters the final life stage, viscous decay, which is dominated by wall-friction. We show that this stage can be modeled by a one-dimensional heat equation, and that self-similar velocity profiles collapse onto the theoretical solution.
△ Less
Submitted 22 September, 2017; v1 submitted 25 April, 2017;
originally announced April 2017.
-
A parallel interaction potential approach coupled with the immersed boundary method for fully resolved simulations of deformable interfaces and membranes
Authors:
Vamsi Spandan,
Valentina Meschini,
Rodolfo Ostilla-Monico,
Detlef Lohse,
Giorgio Querzoli,
Marco D de Tullio,
Roberto Verzicco
Abstract:
In this paper we show and discuss the use of a versatile interaction potential approach coupled with an immersed boundary method to simulate a variety of flows involving deformable bodies. In particular, we focus on two kinds of problems, namely (i) deformation of liquid-liquid interfaces and (ii) flow in the left ventricle of the heart with either a mechanical or a natural valve. Both examples ha…
▽ More
In this paper we show and discuss the use of a versatile interaction potential approach coupled with an immersed boundary method to simulate a variety of flows involving deformable bodies. In particular, we focus on two kinds of problems, namely (i) deformation of liquid-liquid interfaces and (ii) flow in the left ventricle of the heart with either a mechanical or a natural valve. Both examples have in common the two-way interaction of the flow with a deformable interface or a membrane. The interaction potential approach (de Tullio & Pascazio, Jou. Comp. Phys., 2016; Tanaka, Wada and Nakamura, Computational Biomechanics, 2016) with minor modifications can be used to capture the deformation dynamics in both classes of problems. We show that the approach can be used to replicate the deformation dynamics of liquid-liquid interfaces through the use of ad-hoc elastic constants. The results from our simulations agree very well with previous studies on the deformation of drops in standard flow configurations such as deforming drop in a shear flow or a cross flow. We show that the same potential approach can also be used to study the flow in the left ventricle of the heart. The flow imposed into the ventricle interacts dynamically with the mitral valve (mechanical or natural) and the ventricle which are simulated using the same model. Results from these simulations are compared with ad- hoc in-house experimental measurements. Finally, a parallelisation scheme is presented, as parallelisation is unavoidable when studying large scale problems involving several thousands of simultaneously deforming bodies on hundreds of distributed memory computing processors.
△ Less
Submitted 11 December, 2016;
originally announced December 2016.
-
Deformation and orientation statistics of neutrally buoyant sub-Kolmogorov ellipsoidal droplets in turbulent Taylor-Couette flow
Authors:
Vamsi Spandan,
Roberto Verzicco,
Detlef Lohse
Abstract:
The influence of the underlying flow topology on the shape and size of sub-Kolmogorov droplets dispersed in a turbulent flow is of considerable interest in many industrial and scientific applications. In this work we study the deformation and orientation statistics of sub-Kolmogorov droplets dispersed into a turbulent Taylor-Couette flow. Along with Direct Numerical Simulations (DNS) of the carrie…
▽ More
The influence of the underlying flow topology on the shape and size of sub-Kolmogorov droplets dispersed in a turbulent flow is of considerable interest in many industrial and scientific applications. In this work we study the deformation and orientation statistics of sub-Kolmogorov droplets dispersed into a turbulent Taylor-Couette flow. Along with Direct Numerical Simulations (DNS) of the carrier phase and Lagrangian tracking of the dispersed droplets, we solve a phenomenological equation proposed by Maffettone and Minale (\emph{J. Fluid Mech.} 78, 227-241 (1998)) to track the shape evolution and orientation of approximately $10^5$ ellipsoidal droplets. By varying the capillary number $Ca$ and viscosity ratio $\hat μ$ of the droplets we find that the droplets deform more with increasing capillary number $Ca$ and this effect is more pronounced in the boundary layer regions. This indicates that along with a capillary number effect there is also a strong correlation between spatial position and degree of deformation of the droplet. Regardless of the capillary number $Ca$, the major-axis of the ellipsoids tends to align with the stream-wise direction and the extensional strain rate eigen direction in the boundary layer region while the distribution is highly isotropic in the bulk. When the viscosity ratio between the droplet and the carrier fluid is increased we find that there is no preferential stretched axis which is due to the increased influence of rotation over stretching and relaxation. Droplets in high viscosity ratio systems are thus less deformed and oblate (disk-like) as compared to highly deformed prolate (cigar-like) droplets in low viscosity ratio systems.
△ Less
Submitted 13 June, 2016;
originally announced June 2016.
-
Drag reduction in numerical two-phase Taylor-Couette turbulence using an Euler-Lagrange approach
Authors:
Vamsi Spandan,
Rodolfo Ostilla-Monico,
Roberto Verzicco,
Detlef Lohse
Abstract:
Two-phase turbulent Taylor-Couette (TC) flow is simulated using an Euler-Lagrange approach to study the effects of a secondary phase dispersed into a turbulent carrier phase (here bubbles dispersed into water). The dynamics of the carrier phase is computed using Direct Numerical Simulations (DNS) in an Eulerian framework, while the bubbles are tracked in a Lagrangian manner by modelling the effect…
▽ More
Two-phase turbulent Taylor-Couette (TC) flow is simulated using an Euler-Lagrange approach to study the effects of a secondary phase dispersed into a turbulent carrier phase (here bubbles dispersed into water). The dynamics of the carrier phase is computed using Direct Numerical Simulations (DNS) in an Eulerian framework, while the bubbles are tracked in a Lagrangian manner by modelling the effective drag, lift, added mass and buoyancy force acting on them. Two-way coupling is implemented between the dispersed phase and the carrier phase which allows for momentum exchange among both phases and to study the effect of the dispersed phase on the carrier phase dynamics. The radius ratio of the TC setup is fixed to $η=0.833$, and a maximum inner cylinder Reynolds number of $Re_i=8000$ is reached. We vary the Froude number ($Fr$), which is the ratio of the centripetal to the gravitational acceleration of the dispersed phase and study its effect on the net torque required to drive the TC system. For the two-phase TC system, we observe drag reduction, i.e., the torque required to drive the inner cylinder is less compared to that of the single phase system. The net drag reduction decreases with increasing Reynolds number $Re_i$, which is consistent with previous experimental findings (Murai et al. 2005, 2008). The drag reduction is strongly related to the Froude number: for fixed Reynolds number we observe higher drag reduction when $Fr < 1$ than for with$ Fr > 1$. This buoyancy effect is more prominent in low $Re_i$ systems and decreases with increasing Reynolds number $Re_i$. We trace the drag reduction back to the weakening of the angular momentum carrying Taylor rolls by the rising bubbles.
△ Less
Submitted 22 May, 2016; v1 submitted 5 October, 2015;
originally announced October 2015.
