AI-powered multimodal modeling of personalized hemodynamics in aortic stenosis

Caglar Ozturk,1,2† Daniel H. Pak,3† Luca Rosalia,1,4
Debkalpa Goswami,5,6 Mary E. Robakowski,5,7 Raymond McKay,8
Christopher T. Nguyen,5,6 James S. Duncan,3∗ Ellen T. Roche1,4,9∗

1 Institute for Medical Engineering and Science, Massachusetts Institute of Technology,
Cambridge, MA, USA
2 Bioengineering Science Research Group, School of Engineering, University of Southampton,
Southampton, UK
3 Department of Biomedical Engineering, Yale University, New Haven, CT, USA
4 Health Sciences and Technology Program, Harvard–Massachusetts Institute of Technology,
Cambridge, MA, USA
5 Cardiovascular Innovation Research Center, Heart, Vascular & Thoracic Institute,
Cleveland Clinic, Cleveland, OH, USA
6 Department of Cardiovascular Medicine, Heart, Vascular & Thoracic Institute,
Cleveland Clinic, Cleveland, OH, USA
7Department of Chemical and Biomedical Engineering, Cleveland State University,
Cleveland, OH, USA
8 Interventional Cardiology, Hartford Hospital, Hartford, CT, USA
9 Department of Mechanical Engineering, Massachusetts Institute of Technology,
Cambridge, MA, USA

Corresponding authors. E-mails: [email protected] (JSD); [email protected] (ETR)
These authors contributed equally to this work.

Keywords: deep learning; fluid-structure interaction; heart meshing; multimodal modeling;
computational fluid dynamics; aortic stenosis

Aortic stenosis (AS) is the most common valvular heart disease in developed countries. High-fidelity preclinical models can improve AS management by enabling therapeutic innovation, early diagnosis, and tailored treatment planning. However, their use is currently limited by complex workflows necessitating lengthy expert-driven manual operations. Here, we propose an AI-powered computational framework for accelerated and democratized patient-specific modeling of AS hemodynamics from computed tomography. First, we demonstrate that our automated meshing algorithms can generate task-ready geometries for both computational and benchtop simulations with higher accuracy and 100 times faster than existing approaches. Then, we show that our approach can be integrated with fluid-structure interaction and soft robotics models to accurately recapitulate a broad spectrum of clinical hemodynamic measurements of diverse AS patients. The efficiency and reliability of these algorithms make them an ideal complementary tool for personalized high-fidelity modeling of AS biomechanics, hemodynamics, and treatment planning.

Introduction

Aortic stenosis (AS) is a progressive pathological condition characterized by the narrowing of the aortic valve (AV) orifice. In AS, calcium often accumulates on the valve leaflets, affecting the opening and closing of the AV  (?, ?). AS is the prevailing valvular heart condition in developed countries, affecting 2-5% of adults over 65 years old  (?, ?, ?, ?). Due to the aging population, these figures are projected to triple over the next few decades  (?). As a result of increasing the left ventricular (LV) afterload, AS not only manifests as symptoms including dyspnea, syncope, and angina, but may also initiate a cascade of heart abnormalities  (?, ?, ?). Recent guidelines have recommended early management of AS to reduce major adverse cardiovascular and cerebrovascular events  (?). The growing prevalence of AS and the heterogeneity in the anatomy and hemodynamics associated with AS underscore the need for high-fidelity models that can enhance the management of each individual patient  (?, ?).

High-fidelity patient-specific models have the potential to improve the standard-of-care for AS diagnosis and treatment, as current diagnostic methods -- largely based on ultrasound imaging -- may underestimate cardiovascular risks in patients with only mildly abnormal hemodynamics  (?, ?, ?, ?). Diagnostically, computational models can complement these methods by analyzing alternative sources of patient data and providing additional diagnostic information  (?, ?, ?). Therapeutically, physical and digital twins can help predict risks (e.g., stroke, paravalvular leak, and coronary obstruction) associated with current interventional and surgical approaches, such as transcatheter aortic valve replacement (TAVR). Therefore, these models have the potential to improve patient outcome via device optimization and personalized treatment planning  (?, ?, ?, ?).

Computational geometric reconstruction from patient images is essential for high-fidelity patient-specific modeling of AS. Due to the complex structure of calcified AV, existing methods have been mostly limited to static single-frame reconstruction using sequential refinements from voxelgrid segmentation and parametric surfaces  (?, ?, ?, ?). With this sequential approach, extensive manual post-processing is often required for each downstream analysis, leading to significant challenges in reproducibility as well as in the widespread adoption of AS models. This limitation is further exacerbated for dynamic multi-frame modeling, which traditionally involves subsequent feature-based registration or computational simulations with active material models  (?, ?, ?). Some methods have circumvented the reconstruction steps by utilizing simplified parameterization  (?, ?), ad-hoc input flow  (?, ?), or highly tunable soft robotic systems  (?, ?). However, the full 3D geometry of the relevant heart structures is still required to recapitulate the detailed blood flow characteristics of AS, such as flow vorticity and TAVR-induced blood stasis  (?, ?, ?).

Here, we present a computational framework for personalized modeling of AS hemodynamics with detailed 3D patient geometry (Fig. 1). The proposed fully automated meshing algorithms empowered by artificial intelligence (AI) significantly enhance the speed and accuracy of AS geometry reconstruction, effectively addressing the scalability and practical limitations of conventional engineering approaches. We demonstrate the versatility of our framework through multimodal modeling, including static, dynamic, computational, and benchtop analyses. For computational modeling, our fluid-structure coupled multi-physics model enables precise simulations of the valve leaflet motion and the resulting blood flow at a high temporal resolution. Using only cardiac computed tomography (CT) angiography as the input patient data, our in silico and in vitro models accurately reproduce the clinical continuous-wave (CW) Doppler measurements of hemodynamics for AS patients. Our framework may help accelerate the development and usage of highly precise models for AS hemodynamics in research and clinical practice.

[Uncaptioned image]

Fig. 1. Overview of AI-powered personalized modeling approach for AS. (A) Schematic illustrating the calcification process of the AV leaflets in the aging heart and changes in the orifice area through disease progression. (B) The overall workflow of develo** a patient-specific model from CT images to recapitulate clinical hemodynamic measurements of AS patients, where we propose the use of our DeepCarve-FSI framework to replace conventional heart meshing techniques.

Results

AI-powered geometry reconstruction for computational AS modeling

We leveraged AI to directly generate the most complex finite element (FE) representation of AS geometry -- volumetric meshes. From this detailed mesh, we can automatically derive all other necessary representations, ensuring high-quality inputs with accurate multi-part relationships for various modeling modalities. Our AI-powered volumetric meshing involves two stages: heart tissue reconstruction and calcium deposit attachments. We have previously developed related algorithms for both stages, namely DeepCarve  (?) and C-MAC  (?), but their use cases have been limited to static computational structural analyses. Here, we extend these algorithms to provide a holistic computational framework for multimodal modeling, and provide the first set of validations against clinical measurements of AS hemodynamics.

DeepCarve constitutes an image-processing neural network that can rapidly reconstruct simulation-ready volumetric meshes from pre-TAVR CT (Movie S1). The original model was designed for the aortic valvular complex and partial LV with minimized solid element distortions, which often led to conservative deformation and imprecise LV boundaries. This is especially problematic for the elderly AS population, who often exhibits unusual LV volume due to concurrent cardiomyopathies or remodeling processes secondary to AS. For dynamic flow analysis, precise delineation of the entire LV boundary is necessary to accurately define the boundary of the fluid domain. Here, we therefore re-defined the LV mesh to entirely consist of surface elements and introduced surface element quality metrics in the training loss. Further, we modified the valve leaflet meshes to contain three layers of hexahedral elements in the thickness direction, which increases the accuracy of the highly dynamic leaflet movements.  (?, ?).

We performed geometric evaluations of the AI-generated meshes via quantitative measurements (Table. 1) and qualitative visualizations (Fig. 2A). We focused on evaluating the spatial accuracy as well as the element quality of the reconstructed meshes. Compared to conventional registration, which consists of a deep learning segmentation algorithm followed by segmentation-based template registration (Methods; Fig. S1, Fig. S2, Movie S2), our model showed statistically significant improvements in all evaluation metrics for all structural components. The performance differences are also visually apparent, especially along the LV endocardium and the outer aortic wall. In later sections, we will demonstrate how these geometric improvements lead to increased downstream task performance in hemodynamic modeling.

[Uncaptioned image]

Fig. 2. Overview of our AI-powered geometry reconstruction algorithms for computational simulations. (A) Visualization of our AI-generated simulation meshes’ element quality and spatial accuracy. (B) Schematic of our multi-frame meshing approach for computational flow simulations.

Additionally, the modified DeepCarve algorithm substantially outperformed the original DeepCarve for the average LV surface accuracy (1.62 \rightarrow 0.87), demonstrating the benefit of modeling the LV using surfaces instead of solids. The overall surface accuracy of the aorta and leaflets also improved (0.84 \rightarrow 0.60), albeit at a slight cost to the volumetric element quality due to the division of the thickness layers in the valve leaflets. Nonetheless, no degenerate elements were produced by DeepCarve, as indicated by \mid Jac <0\mid\;<0∣ < 0 being 0. This marks the first successful demonstration of the simultaneous surface and volumetric meshing of the AS geometry and the capability of DeepCarve to accurately model extremely thin tri-layer hexahedral leaflet elements.

Table 1. Spatial accuracy and element quality of the meshes generated by the baseline method and the modified DeepCarve. CD: normalized symmetric chamfer distance, \mid Jac \mid: scaled jacobian determinant. Values are mean ±plus-or-minus\pm± std across all test-set patients, except for \mid Jac <0\mid\;<0∣ < 0, which is the sum. indicates p<0.05𝑝0.05p<0.05italic_p < 0.05 between the two rows.

\robustify
CD (mm) \downarrow LV CD (mm) \downarrow Aorta & AV \mid Jac <0\mid\;<0∣ < 0 \downarrow Aorta & AV \mid Jac \mid \uparrow Aorta & AV Skew \downarrow Aorta & AV
Conventional registration 0.930.930.930.93 p m 0.13 0.840.840.840.84 p m 0.19 14 0.710.710.710.71 p m 0.04 0.520.520.520.52 p m 0.05
DeepCarve 0.870.870.870.87 p m 0.12 0.600.600.600.60 p m 0.17 0 0.850.850.850.85 p m 0.02 0.360.360.360.36 p m 0.03

Following DeepCarve, we applied C-MAC without modification to automatically incorporate calcification meshes while maintaining the existing heart mesh topology. The qualitative visualization demonstrates accurate, high-quality meshes for all components of the calcified AV and LV (Fig. 2A). The robustness of the final meshes were also verified by the successful completion of downstream analyses without any mesh degeneracy errors.

We performed dynamic computational modeling of AS hemodynamics using two steps (Fig. 2B): DeepCarve for the time-resolved geometry reconstruction and fluid-structure interaction (FSI) simulations for the detailed valve leaflet dynamics. For each patient, we applied the modified DeepCarve to each of the 8-10 CT phases independently to obtain the corresponding time-resolved meshes. Owing to our deep learning-based template deformation strategy and the shared imaging features between each time frame, the independently predicted meshes exhibited excellent intra-patient mesh correspondence, similar to  (?). Thus, we used the resulting meshes directly for motion interpolation during simulations. The total processing time of DeepCarve for all cardiac phases was around 2 seconds on an NVIDIA GPU RTX3080Ti laptop workstation, a 100-fold speed increase from conventional registration approaches. C-MAC was only applied to the first-frame mesh, as the calcification meshes for all other frames are positioned based on the motion of the attached structural components.

Robust automated conversion to 3D printing geometry

Our framework facilitates straightforward repurposing of the auto-generated meshes for 3D printed benchtop models. The differences in the meshing criteria necessitate conversion algorithms for the 3D printing geometry, but the entire process can be simplified to a single-button click with a total processing time of 10 seconds for each frame (Fig. 3A), due to the strong inter-part relationships established by our AI-powered mesh reconstruction methods. The component-agnostic meshing criteria for 3D printing include (1) using only triangular elements, (2) generating more uniform and smoother elements, and (3) ensuring overlap** surfaces for multi-part attachments. The head-to-head comparison between the AI-generated simulation mesh and its derivative 3D printing mesh demonstrates that our conversion algorithms can easily satisfy all desired criteria while maintaining great spatial consistency to the original mesh (Fig. 3A).

[Uncaptioned image]

Fig. 3. Robust automated conversion to 3D printing geometry. (A) Qualitative demonstration of the quality of the 3D printing mesh and its spatial consistency to the corresponding simulation mesh. Detailed steps of the conversion algorithms for the (B) AV leaflets and (C) the combined LV and aorta.

Three structural components are often considered for AS benchtop modeling: calcification, valve leaflets, and the inner wall of the aorta and LV  (?, ?, ?). We achieved calcification conversion by extracting the isosurface from C-MAC’s post-processed segmentation and subsequently applying standard remeshing and smoothing operations. We performed leaflet conversion with additional thickness adjustment steps, where we used finer-resolution voxelgrid signed distance functions (SDF) to robustly extract surfaces at various level sets (Fig. 3B). These steps enabled robust automated tuning of the leaflet thickness during 3D printing iterations, which helped establish compatibility with the 3D printer resolution and satisfy the surface overlap criteria for multi-part attachments.

To obtain a single-frame 3D printing mesh of the aorta and LV, we can simply apply the same algorithm as the leaflets while using the closed inner wall surface as the SDF boundary. However, to further tailor the model for soft robotics applications, we incorporated additional steps to combine the heart geometries from two different cardiac phases (Fig. 3C). We utilized the peak systolic AV geometry to model the valve’s open state, adapting to the limitations of standard 3D printers in replicating the soft leaflet material properties for dynamic movements. We used the end diastolic LV to model the most relaxed LV state, from which the LV motion throughout the entire cardiac cycle can be reproduced via soft robotic contractions. To address the apparent position mismatch from the initial merging of the two time-separated meshes, we performed mesh node displacement optimizations to generate a smooth inner wall surface, which then served as an input to the remaining meshing steps resembling leaflet conversion (Movie S3).

The combination of geometries at two time points was designed specifically for our experimental capabilities, but different combinations of our conversion algorithms can generate a wide variety of 3D printable meshes for physical models. The robust automated conversion was made possible by the strong inter-part relationships established by our AI-powered mesh reconstruction methods.

[Uncaptioned image]

Fig. 4. Overview of the computational model and patient-specific flow patterns. (A) Schematic of FSI approach (B) Illustration of AI-powered simulation ready mesh. Schematic of one-way coupling, nodal displacement prescribed to LV wall. (C-G) Velocity map distributions in the anterior-posterior plane for patients 1 to 5, respectively. Velocity fields are captured during the systolic temporal frame when the AV velocity is at its peak state in the cardiac cycle.

Computational fluid model and insilico hemodynamic assessment

We developed a computational framework that includes a FE model of the heart using AI-generated meshes of LV, aorta, AV, and calcium (Methods). Coupling the FE model of the heart with computational fluid dynamics (CFD) utilizing FSI architecture allowed us to simulate the global behavior of the patient-specific left side heart and hemodynamics (Fig. 4A). The DeepCarve algorithm was used to reconstruct time-resolved geometries, which were then utilized for motion interpolation of the heart (Movie S4). We used the first-frame mesh from DeepCarve and C-MAC to place the valve and calcification meshes. By prescribing nodal displacement to the LV mesh, we were able to simulate heart motion based on dynamic CT data and assess patient-specific hemodynamics (Fig. 4B). Using a comparison of global flow patterns and velocity magnitudes, we were able to qualitatively assess the AS hemodynamics specific to each patient. Figure 4C-G shows the cross-sectional velocity contours for five patient heart models during the peak systole. The stenotic morphology of the valve leaflets caused the flow jets to be more prominent at the contraction of the heart (Movie S4). Despite variations in heart size and boundary conditions among patients, the maximum velocity consistently occurred at the valve orifice in each patient/disease scenario, as expected. Following a remarkable elevation of the velocity in proximity to the valve orifice, the flow demonstrated a plug-like flow profile, remaining relatively stable within the jet orifice. The peak AV velocity was determined when the flow velocity across the AV reached its peak at the tips of the cusps. Patient 4 reached a peak velocity of 5.4 m/s, whereas Patient 1 had the lowest peak velocity of 4 m/s.

Recreating patient-specific valve anatomies and AS hemodynamics

To assess the efficacy of our computational framework in obtaining accurate hemodynamic data, we conducted a comparative analysis with the conventional algorithm (Methods) (Fig. 5A). To re-create clinical measurements obtained via ultrasound imaging, we calculated the velocity profile across the AV by placing a short axis plane above the valve orifice (Fig. 5B). The cutting plane denotes the monitoring location for velocity measurements through the valve. Patients’ clinical echocardiography data served as our ground truth when comparing hemodynamic findings from the computational models. For quantitative analysis, a set of global hemodynamic metrics, commonly used in clinical settings, was calculated from the FSI simulations with both the DeepCarve model and the conventional model (CM) (Fig. 5D-G, and Fig. S4). From the simulation, we determined the velocity values (Vpeak; Fig. 5D) and the effective orifice area (EOA) of the AV by calculating the opening area of its deformed shape at near peak systole (Fig. 5C). Likewise, we calculated the peak (dPmax; Fig. 5E) and mean (dPmean; Fig. 5F) transvalvular pressure gradient by measuring the flow upstream and downstream through planes above and below the valve annuli. Figure 5G reports another clinical metric, left ventricular ejection fraction (LVEF), based on the volumetric change of LV through the cardiac cycle. The results show that the FSI simulations and the subject-specific echo data follow the same trends and are of comparable magnitude. The simulations using the DeepCarve model more closely matched the clinical echo data in all target metrics, indicating a mean absolute deviation of 3.8 ± 1.3% for all metrics compared with the conventional approach (12.4 ± 3.4%). We calculated the deviations in Vpeak to be 2.4 ± 1.5% compared to 9.8 ± 1.6%, dPmax as 5.3 ± 0.9% compared to 13.9 ± 3.1%, dPmean as 4.1 ± 1.3% compared to 14.0 ± 4.1%, and LVEF as 3.3 ± 2.9% compared to 12.1 ± 8.2% for DeepCarve and conventional methods.

[Uncaptioned image]

Fig. 5. Comparison of patient-specific hemodynamic findings with AI-powered and conventional algorithms. (A) Constructed valve and calcium geometry using DeepCarve and conventional meshing. (B) The visualization of particle pathlines based on FSI simulations. The cutting plane denote the probe location for AV velocity measurements. (C) AV profiles of patients 1-5 during peak systole in the cardiac cycle. Comparison of FSI simulations with DeepCarve and conventional meshing/registration, shown by measured hemodynamics metrics of (D) Vpeak, (E) dPmax, (F) dPmean, (G) LVEF, demonstrating that DeepCarve-FSI allows for more accurate hemodynamic measurements and agrees well with the ground truth (clinical echo data). Each error bar represents means ± 1SD (n= 3 consecutive heart cycles).

3D printing patient-specific meshes and in vitro hemodynamic assessment using echocardiography

We adopted our mock circulatory left heart flow loop to test the functionality of our automated mesh conversion algorithm for 3D printing and benchtop testing  (?). The soft robotic sleeve served as the actuator for the 3D-printed heart and drives fluid flow in the circuit, without the need for an additional pump (Fig. 6A). The LV sleeve was tailored to fit the patient’s anatomy and activated to mimic anatomical filling, emptying, and wall motion during systole. To validate the computational findings and the accuracy of our mesh conversion framework for 3D printing, we manufactured the anatomies of Patient 1 and 2 (Fig. 6B), and recreated their hemodynamic profiles in our in vitro system (Fig. S5). The automated mesh conversion process successfully met the watertightness requirement and did not pose any surface overlap or compatibility issues with the 3D printer. We primarily used echocardiography to compute the flow velocity through the AV and at the left ventricular outflow tract (LVOT) (Movie S5). The representative continuous Doppler waveforms in Figure 6C showcase the aortic velocity profiles for Patients 1 and 2. The measured metrics of Vpeak,VLVOT, dPmean, dPmax, and LVEF closely matched with the clinical patient data in both cases. For each of these metrics, we computed the compounded absolute deviation (%) from the corresponding clinical echo report and presented the similarity between the FSI and the in vitro studies (Fig. 6D). The results indicated that the FSI simulations using conventional methodologies had the highest deviation of 11.1 ± 3.2%, while the DeepCarve approach exhibited the lowest deviation of 5.9 ± 1.1% compared to the in vitro value of 8.8 ± 2.0%. These findings suggest DeepCarve-FSI approach agrees more closely with the clinical echo data, demonstrating the accurate performance of our AI-powered computational framework. Analogously, the in vitro test results exhibited similar patterns as the clinical data but had a comparatively higher margin of error than the DeepCarve-FSI technique, which will be discussed later. The deviation in LVEF in in vitro studies was slightly less prominent than other metrics and was within the same ranges of clinical data and DeepCarve-FSI. This is likely due to our automated mesh conversion for 3D printing, which results in accurate LV volumes at both end-systole (ESV) and end-diastole (EDV). Overall, these data showcase our platform’s capability to replicate LV hemodynamics accurately and quickly in a benchtop setting.

[Uncaptioned image]

Fig. 6. A platform for testing AI-powered 3D printing mesh with soft robotic models. (A) Overview of soft robotic system. (B) As an example, the geometries of Patients 1 and 2 were 3D printed using our automated conversion. (C) Representative echocardiographic velocity waveforms across the aortic valve from CW Doppler measurements during actuation by the soft robotic LV sleeve in three consecutive cardiac cycles. (D) The similarities between clinical metrics estimated from in vitro experiments and in silico simulations with FSI using conventional meshing/registration method (FSI-CM) and DeepCarve (FSI-DeepCarve). Clinical parameters include LVEF, mean pressure gradient (MP), peak pressure gradient (PP), dimensionless velocity index (DVI), and peak aortic velocity (PV).

Discussion

In this paper, we propose and validate a start-to-end computational pipeline for patient-specific hemodynamic analysis for AS using CT imaging patient data. We extend the DeepCarve method to a multi-modal tool that generates fully coupled patient-specific FSI and physical benchtop models of the left heart. Compared to traditional techniques, the proposed method demonstrates improved geometry reconstruction at much faster test-time performance. The reconstruction quality is particularly important for accurately representing the highly dynamic and thin AV leaflets and irregularly dispersed calcium deposits, both of which are crucial for simulating AS. Our solution entails using DeepCarve on each individual CT time frame that exploits the deep learning template deformation strategy on shared image features across time frames. Additionally, we showcase the direct and automatic transformation of our AI-generated meshes into meshes suitable for 3D printing. Our robust volumetric mesh outputs exhibit well-defined multi-part relationships between different heart components, which allows our automated transformations to easily meet the necessary meshing criteria while maintaining high/elevated spatial consistency to the simulation mesh.

We used clinical data from a cohort of AS patients to validate our approach as a platform for prediction of hemodynamic diagnostic metrics of AS. Our model was shown to generate the left heart kinematics as visualized by CT data and predict hemodynamic changes associated with patients’ disease. As a result, our AI-powered FSI model not only recapitulates the diverse range of clinical metrics of AS, but also offers accurate and efficient solution in comparison to traditional methods.

Some limitations of this study are noted. The primary shortcoming of our meshing approach is the limited flexibility of the template deformation-based approach. For complex anatomies or, for example, congenital heart defects, we would need a modified template for each phenotype. Our FSI method could predict AS hemodynamics despite the intrinsic limitation of current imaging techniques. However, it was based on several assumptions. For example, we assumed a healthy leaflet condition and assigned the same hyperelastic material properties to the valve leaflets regardless of the individual patient’s disease state (Methods). Similarly, we implemented the same linear elastic material properties for calcium geometries. Another limitation is the relatively lower resolution (both spatial and temporal) of the original CT data at which the valve leaflet dynamics are captured by the data-driven meshing approach. Although our model can effectively create the dynamics of the valve leaflet even with low resolution of CT data, the data-driven meshing technique necessitates a fully coupled analysis to simulate the valve’s behavior during an ejection period, leading to longer simulation periods. It is also worth noting that our computational FSI framework uses a commercial solver package (Methods) and requires some manual operations to integrate the mesh outputs from DeepCarve into the simulation platform. To fully automate the planning workflow from a raw CT scan to personalized hemodynamic results, an open-source platform for FSI modeling would be necessary. The in vitro testing framework also contains some limitations. Our 3D printing method allows for the production of soft and flexible structures, but its material characteristics still result in an excessive hypokinetic state of the valve leaflet due to limitations in the 3D printing techniques that we adopted, which required a minimum thickness of 0.6mm of the leaflets. While it may seem rational to use fixed leaflets to calculate the flow profile of AS during peak systole, there is a potential mismatch in accurately determining the effective area opening during this phase. This is due to the limited temporal resolution of the original CT data, which offers only eight time frames per cycle.

Further work might enhance the accuracy of the valve dynamics through AI to tackle the constraints posed by low-resolution CT data and also eliminate the need for any specific material definitions for leaflets and calcium. This approach would further reduce the simulation time while replicating not only the heart but also the precise valve motion detected in the original CT data. Some of the limitations could be also addressed in the future with higher-resolution CT datasets. By using super-resolution CT images, we can identify the valve dynamics and unique stenotic profile more accurately. This can potentially speed up the translation to clinical use by reducing the overall time required for the computational pipeline from start to end. Additionally, it would enable the creation of accurate 3D printed models that replicate the hemodynamics of AS even more accurately. Alternatively, for develo** efficient in vitro platforms, we could seek advancements in multi-material 3D printing strategies that might allow us to manufacture enhanced valve leaflets and calcium with accurate anatomical thicknesses, and biomimetic mechanical properties. In future work, we aim to expand the range of clinical scenarios that we can simulate, beyond AS. We seek to focus on interventional and surgical approaches for AS by recapitulating the correct hemodynamics specific to each patient. For instance, our computational pipeline may assist in planning TAVR surgery and identifying subgroups within AS populations where TAVR might be advantageous and delivered without any risk.

This work addresses two major but often overlooked challenges in develo** preclinical cardiovascular models (in silico, in vitro) for patients with AS. First, current image segmentation protocols rely heavily on manual work and pose significant inter and intra-expert variability. The proposed technique significantly reduces the computational time required for segmentation and meshing, from several hours of manual work to approximately 1 minute of automated computing. Additionally, it provides higher accuracy of patient-specific heart, valve, and calcium mesh. Second, the complexity and high computational costs associated with multiphysics heart models, along with the requirement for skilled researchers to operate them, present a major barrier to the translation of digital (in silico) and benchtop (in vitro) twins in clinical practice. The process of creating patient-specific 3D geometry, such as preparing a mesh suitable for simulation, separating the entire body into multiple, contact-free parts, determining heart motion, and assigning electromechanical tissue properties and appropriate boundary conditions to achieve a beating motion, collectively demands substantial computational resources and effort from trained researchers. Similarly, the accuracy of mimicking heart motion and AS flow profile in benchtop models relies heavily on the quality of image segmentation and 3D printed geometry. Any discrepancy between the patients’ CT images and 3D printed anatomies compromises this accuracy, thereby reducing the feasibility of using these hydrodynamic models in a clinical setting. The proposed FSI pipeline with DeepCarve addresses these issues by recapitulating the patient-specific heart motion and AS hemodynamics without requiring any sophisticated electromechanical heart models, massive supercomputers, or days-long simulation time. In conclusion, the computational pipeline presented in this work offers fast, high-fidelity simulation capabilities and has potential to accelerate the development of intracardiac interventions and tools for evaluating and treating AS. Our DeepCarve-FSI technique delivers an effective solution for reproducing the left heart dynamics in both computational and benchtop models. It could be adapted to use in clinics for device selection for TAVR, procedural planning, and outcome prediction. We are hopeful that our model may further advance cardiac twin models by reducing the computational complexity involved in modeling AS and other cardiovascular conditions.

Methods

Data acquisition and pre-processing

A total of 79 3D CT scans were collected to train and geometrically evaluate the DeepCarve algorithm. 65 pre-TAVR CT scans were obtained from 54 patients at Hartford hospital with an IRB-approved protocol. The remaining 14 scans were from the training set of the MM-WHS public dataset, which mostly consisted of volunteer subjects without AS  (?). The testing set was ensured to never have any overlap** patients with the training and validation sets. The training/validation/testing splits were 35/9/35. All scans showed the entire LV myocardium and tri-leaflet AV with different levels of calcification. The raw image in plane pixel spacing was in the range [0.281, 0.727] mm, with a median of 0.488 mm, and the slice thickness was in the range [0.450, 1.000] mm, with a median of 0.625 mm. Slices were acquired in the axial view.

The associated ground-truth labels included the surface meshes of (1) the inner wall of the ascending aorta, (2) the inflow side of the AV leaflets, and (3) the LV myocardium. The labels were obtained using semi-automated methods as outlined in  (?). The CT intensity was normalized by linearly map** [-158, 864] Hounsefield Units (HU) to [0, 1], and the voxel spacings were resampled to an isotropic resolution of 1.25mm with a fixed field of view of 128 voxels in each axis.

For hemodynamics modeling, 5 additional time-resolved pre-procedural CT scans were collected from 5 different TAVR patients at Hartford hospital. The imaging characteristics and pre-processing steps were identical to above. For clinical validation, the corresponding pre-TAVR reports from comprehensive echocardiography were used.

Modified DeepCarve training details

The modified DeepCarve in this work utilizes (1) the surface representation of the entire LV myocardium and (2) the tri-layer hexahedral elements of the AV leaflets. These changes were implemented by first modifying the original template using Solidworks (Dassault Systèmes, 2023) and Hypermesh (Altair, 2022), and then modifying the training loss to be compatible with the simultaneous optimization of surface and volumetric meshes. In addition to the new templates and training loss, a random translation augmentation was added to the original training procedure, similar to C-MAC’s implementation of the model  (?). The training set-up was otherwise identical to DeepCarve  (?). Briefly, a U-net architecture was employed with extra skip connections and a modified prediction head to predict b-spline diffeomorphic deformation fields from 3D CT. The exact architectural definitions can be found in  (?, ?). We used the Adam optimizer  (?) with a fixed learning rate of 1e-4, batch size of 1, and 8000 training epochs.

The training loss function for our modified DeepCarve was

=[1Nn=1N[ch]n]+λ1ARAP+λ2ASqrtsolid+λ3normal+λ4lap+λ5edgesurfdelimited-[]1𝑁superscriptsubscript𝑛1𝑁subscriptdelimited-[]subscript𝑐𝑛subscriptsubscript𝜆1subscript𝐴𝑅𝐴𝑃subscript𝜆2subscript𝐴𝑆𝑞𝑟𝑡subscript𝑠𝑜𝑙𝑖𝑑subscriptsubscript𝜆3subscript𝑛𝑜𝑟𝑚𝑎𝑙subscript𝜆4subscript𝑙𝑎𝑝subscript𝜆5subscript𝑒𝑑𝑔𝑒subscript𝑠𝑢𝑟𝑓\mathcal{L}=\Bigg{[}\frac{1}{N}\sum_{n=1}^{N}\big{[}\mathcal{L}_{ch}\big{]}_{n% }\Bigg{]}+\underbrace{\lambda_{1}\mathcal{L}_{ARAP}+\lambda_{2}\mathcal{L}_{% ASqrt}}_{\mathcal{L}_{solid}}+\underbrace{\lambda_{3}\mathcal{L}_{normal}+% \lambda_{4}\mathcal{L}_{lap}+\lambda_{5}\mathcal{L}_{edge}}_{\mathcal{L}_{surf}}caligraphic_L = [ divide start_ARG 1 end_ARG start_ARG italic_N end_ARG ∑ start_POSTSUBSCRIPT italic_n = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT [ caligraphic_L start_POSTSUBSCRIPT italic_c italic_h end_POSTSUBSCRIPT ] start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ] + under⏟ start_ARG italic_λ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT caligraphic_L start_POSTSUBSCRIPT italic_A italic_R italic_A italic_P end_POSTSUBSCRIPT + italic_λ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT caligraphic_L start_POSTSUBSCRIPT italic_A italic_S italic_q italic_r italic_t end_POSTSUBSCRIPT end_ARG start_POSTSUBSCRIPT caligraphic_L start_POSTSUBSCRIPT italic_s italic_o italic_l italic_i italic_d end_POSTSUBSCRIPT end_POSTSUBSCRIPT + under⏟ start_ARG italic_λ start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT caligraphic_L start_POSTSUBSCRIPT italic_n italic_o italic_r italic_m italic_a italic_l end_POSTSUBSCRIPT + italic_λ start_POSTSUBSCRIPT 4 end_POSTSUBSCRIPT caligraphic_L start_POSTSUBSCRIPT italic_l italic_a italic_p end_POSTSUBSCRIPT + italic_λ start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT caligraphic_L start_POSTSUBSCRIPT italic_e italic_d italic_g italic_e end_POSTSUBSCRIPT end_ARG start_POSTSUBSCRIPT caligraphic_L start_POSTSUBSCRIPT italic_s italic_u italic_r italic_f end_POSTSUBSCRIPT end_POSTSUBSCRIPT (1)

where n𝑛nitalic_n denotes the mesh component index, and N=5𝑁5N=5italic_N = 5 for the LV myocardium, aorta, and 3 aortic leaflets. λi={1,10,10,10,1}subscript𝜆𝑖11010101\lambda_{i}=\{1,10,10,10,1\}italic_λ start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT = { 1 , 10 , 10 , 10 , 1 } for each loss component, respectively, via hyperparameter optimization. Due to the template element characteristics, solidsubscript𝑠𝑜𝑙𝑖𝑑\mathcal{L}_{solid}caligraphic_L start_POSTSUBSCRIPT italic_s italic_o italic_l italic_i italic_d end_POSTSUBSCRIPT entirely governed the element quality of the aorta and the valve leaflets, whereas surfsubscript𝑠𝑢𝑟𝑓\mathcal{L}_{surf}caligraphic_L start_POSTSUBSCRIPT italic_s italic_u italic_r italic_f end_POSTSUBSCRIPT entirely governed the element quality of the LV surface.

The chamfer distance was used to optimize for surface accuracy  (?)

ch=1A𝐚Amin𝐛B𝐚𝐛22+1B𝐛Bmin𝐚A𝐛𝐚22\mathcal{L}_{ch}=\frac{1}{\mid A\mid}\sum_{\mathbf{a}\in A}\min_{\mathbf{b}\in B% }\left\lVert\mathbf{a}-\mathbf{b}\right\rVert_{2}^{2}+\frac{1}{\mid B\mid}\sum% _{\mathbf{b}\in B}\min_{\mathbf{a}\in A}\left\lVert\mathbf{b}-\mathbf{a}\right% \rVert_{2}^{2}caligraphic_L start_POSTSUBSCRIPT italic_c italic_h end_POSTSUBSCRIPT = divide start_ARG 1 end_ARG start_ARG ∣ italic_A ∣ end_ARG ∑ start_POSTSUBSCRIPT bold_a ∈ italic_A end_POSTSUBSCRIPT roman_min start_POSTSUBSCRIPT bold_b ∈ italic_B end_POSTSUBSCRIPT ∥ bold_a - bold_b ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + divide start_ARG 1 end_ARG start_ARG ∣ italic_B ∣ end_ARG ∑ start_POSTSUBSCRIPT bold_b ∈ italic_B end_POSTSUBSCRIPT roman_min start_POSTSUBSCRIPT bold_a ∈ italic_A end_POSTSUBSCRIPT ∥ bold_b - bold_a ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT (2)

where A𝐴Aitalic_A and B𝐵Bitalic_B are two sets of points and 𝐚𝐚\mathbf{a}bold_a and 𝐛𝐛\mathbf{b}bold_b are the set elements, each consisting of 3D point coordinates. The chamfer distance was calculated separately for each component (denoted as [ch]nsubscriptdelimited-[]subscript𝑐𝑛[\mathcal{L}_{ch}]_{n}[ caligraphic_L start_POSTSUBSCRIPT italic_c italic_h end_POSTSUBSCRIPT ] start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT), and then averaged across different components to obtain the final spatial accuracy metric.

To ensure high-quality solid elements, a combination of isotropic and anisotropic distortion energies was used, similar to DeepCarve  (?). The as-rigid-as-possible (ARAP) energy was used for the isotropic component

ARAP=1Kk=1K𝐅k𝐑kF2subscript𝐴𝑅𝐴𝑃1𝐾superscriptsubscript𝑘1𝐾superscriptsubscriptdelimited-∥∥subscript𝐅𝑘subscript𝐑𝑘𝐹2\mathcal{L}_{ARAP}=\frac{1}{K}\sum_{k=1}^{K}\left\lVert\mathbf{F}_{k}-\mathbf{% R}_{k}\right\rVert_{F}^{2}caligraphic_L start_POSTSUBSCRIPT italic_A italic_R italic_A italic_P end_POSTSUBSCRIPT = divide start_ARG 1 end_ARG start_ARG italic_K end_ARG ∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_K end_POSTSUPERSCRIPT ∥ bold_F start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT - bold_R start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT italic_F end_POSTSUBSCRIPT start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT (3)

where k𝑘kitalic_k denotes the solid element index, K𝐾Kitalic_K is the total number of solid elements, and 𝐅ksubscript𝐅𝑘\mathbf{F}_{k}bold_F start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT and 𝐑ksubscript𝐑𝑘\mathbf{R}_{k}bold_R start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT are the deformation gradient and the rotational component of the deformation gradient for the kthsuperscript𝑘thk^{\textrm{th}}italic_k start_POSTSUPERSCRIPT th end_POSTSUPERSCRIPT element. The definitions of 𝐅𝐅\mathbf{F}bold_F and 𝐑𝐑\mathbf{R}bold_R based on the element geometry can be found in  (?, ?). This term represents the uniformly weighted average of the isotropic ARAP energy densities of all solid elements.

The ASqrt energy, a square root variation of the popular anisotrpic St. Venant Kirchoff energy, was used for the anistropic energy component  (?)

ASqrt=1Kk=1K(𝐝kT𝐅kT𝐅k𝐝k1)2subscript𝐴𝑆𝑞𝑟𝑡1𝐾superscriptsubscript𝑘1𝐾superscriptsuperscriptsubscript𝐝𝑘𝑇superscriptsubscript𝐅𝑘𝑇subscript𝐅𝑘subscript𝐝𝑘12\mathcal{L}_{ASqrt}=\frac{1}{K}\sum_{k=1}^{K}\Big{(}\sqrt{\mathbf{d}_{k}^{T}% \mathbf{F}_{k}^{T}\mathbf{F}_{k}\mathbf{d}_{k}}-1\Big{)}^{2}caligraphic_L start_POSTSUBSCRIPT italic_A italic_S italic_q italic_r italic_t end_POSTSUBSCRIPT = divide start_ARG 1 end_ARG start_ARG italic_K end_ARG ∑ start_POSTSUBSCRIPT italic_k = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_K end_POSTSUPERSCRIPT ( square-root start_ARG bold_d start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT bold_F start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT bold_F start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT bold_d start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT end_ARG - 1 ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT (4)

where 𝐝ksubscript𝐝𝑘\mathbf{d}_{k}bold_d start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT denotes the anisotropy direction for calculating the energy density for the kthsuperscript𝑘thk^{\textrm{th}}italic_k start_POSTSUPERSCRIPT th end_POSTSUPERSCRIPT element. Similar to ARAPsubscript𝐴𝑅𝐴𝑃\mathcal{L}_{ARAP}caligraphic_L start_POSTSUBSCRIPT italic_A italic_R italic_A italic_P end_POSTSUBSCRIPT, the anistropic energy densities were averaged uniformly across all solid elements. Following DeepCarve, 𝐝ksubscript𝐝𝑘\mathbf{d}_{k}bold_d start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT was set as the thickness direction of each hexhedral element.

Similar to previous works  (?, ?, ?), three surface element quality metrics were optimized for high-quality surface elements: surface normal consistency, Laplacian smoothness, and edge length correspondence. The surface normal consistency loss is commonly defined as

normal=1𝒩f(𝐧fi,𝐧fj)𝒩f1<𝐧fi,𝐧fj>𝐧fi2𝐧fj2\mathcal{L}_{normal}=\;\frac{1}{\mid\mathcal{N}_{f}\mid}\sum\nolimits_{(% \mathbf{n}_{fi},\mathbf{n}_{fj})\in\mathcal{N}_{f}}1-\frac{<\mathbf{n}_{fi},% \mathbf{n}_{fj}>}{\left\lVert\mathbf{n}_{fi}\right\rVert_{2}\left\lVert\mathbf% {n}_{fj}\right\rVert_{2}}caligraphic_L start_POSTSUBSCRIPT italic_n italic_o italic_r italic_m italic_a italic_l end_POSTSUBSCRIPT = divide start_ARG 1 end_ARG start_ARG ∣ caligraphic_N start_POSTSUBSCRIPT italic_f end_POSTSUBSCRIPT ∣ end_ARG ∑ start_POSTSUBSCRIPT ( bold_n start_POSTSUBSCRIPT italic_f italic_i end_POSTSUBSCRIPT , bold_n start_POSTSUBSCRIPT italic_f italic_j end_POSTSUBSCRIPT ) ∈ caligraphic_N start_POSTSUBSCRIPT italic_f end_POSTSUBSCRIPT end_POSTSUBSCRIPT 1 - divide start_ARG < bold_n start_POSTSUBSCRIPT italic_f italic_i end_POSTSUBSCRIPT , bold_n start_POSTSUBSCRIPT italic_f italic_j end_POSTSUBSCRIPT > end_ARG start_ARG ∥ bold_n start_POSTSUBSCRIPT italic_f italic_i end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ∥ bold_n start_POSTSUBSCRIPT italic_f italic_j end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT end_ARG (5)

where 𝐧fisubscript𝐧𝑓𝑖\mathbf{n}_{fi}bold_n start_POSTSUBSCRIPT italic_f italic_i end_POSTSUBSCRIPT is the surface normal at ithsuperscript𝑖thi^{\textrm{th}}italic_i start_POSTSUPERSCRIPT th end_POSTSUPERSCRIPT element, and 𝒩fsubscript𝒩𝑓\mathcal{N}_{f}caligraphic_N start_POSTSUBSCRIPT italic_f end_POSTSUBSCRIPT is the set of surface normals in all neighboring faces. This term facilitates neighboring faces to maintain similar surface normals.

The uniform Laplacian smoothing loss was defined as

lap=1V𝐯iV1𝒩(𝐯i)𝐯j𝒩(𝐯i)𝐯i𝐯j2subscript𝑙𝑎𝑝1delimited-∣∣𝑉subscriptsubscript𝐯𝑖𝑉subscriptdelimited-∥∥1delimited-∣∣𝒩subscript𝐯𝑖subscriptsubscript𝐯𝑗𝒩subscript𝐯𝑖subscript𝐯𝑖subscript𝐯𝑗2\mathcal{L}_{lap}=\;\frac{1}{\mid V\mid}\sum_{\mathbf{v}_{i}\in V}\left\lVert% \frac{1}{\mid\mathcal{N}(\mathbf{v}_{i})\mid}\sum_{\mathbf{v}_{j}\in\mathcal{N% }(\mathbf{v}_{i})}\mathbf{v}_{i}-\mathbf{v}_{j}\right\rVert_{2}caligraphic_L start_POSTSUBSCRIPT italic_l italic_a italic_p end_POSTSUBSCRIPT = divide start_ARG 1 end_ARG start_ARG ∣ italic_V ∣ end_ARG ∑ start_POSTSUBSCRIPT bold_v start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ∈ italic_V end_POSTSUBSCRIPT ∥ divide start_ARG 1 end_ARG start_ARG ∣ caligraphic_N ( bold_v start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ) ∣ end_ARG ∑ start_POSTSUBSCRIPT bold_v start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∈ caligraphic_N ( bold_v start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ) end_POSTSUBSCRIPT bold_v start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT - bold_v start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT (6)

where V𝑉Vitalic_V is the set of all vertices in the surface mesh, 𝐯isubscript𝐯𝑖\mathbf{v}_{i}bold_v start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT is the ithsuperscript𝑖thi^{\textrm{th}}italic_i start_POSTSUPERSCRIPT th end_POSTSUPERSCRIPT vertex coordinates, and 𝒩𝒩\mathcal{N}caligraphic_N is the set of neighbors for a chosen vertex 𝐯isubscript𝐯𝑖\mathbf{v}_{i}bold_v start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT. This term encourages each node to be in close proximity to the average of its neighboring node positions.

Finally, the edge length correspondence loss was

edge=1ε(𝐯i,𝐯j)ε(𝐯i𝐯j2max(𝐯i,𝐯j)ε𝐯i𝐯j2ϕ(𝐯i)ϕ(𝐯j))2max(𝐯i,𝐯j)εϕ(𝐯i)ϕ(𝐯j)2)2\mathcal{L}_{edge}=\;\frac{1}{\mid\varepsilon\mid}\sum_{(\mathbf{v}_{i},% \mathbf{v}_{j})\in\varepsilon}\Big{(}\frac{\left\lVert\mathbf{v}_{i}-\mathbf{v% }_{j}\right\rVert_{2}}{\max\limits_{(\mathbf{v}_{i}^{\prime},\mathbf{v}_{j}^{% \prime})\in\varepsilon}\left\lVert\mathbf{v}_{i}^{\prime}-\mathbf{v}_{j}^{% \prime}\right\rVert_{2}}-\frac{\left\lVert\phi(\mathbf{v}_{i})-\phi(\mathbf{v}% _{j}))\right\rVert_{2}}{\max\limits_{(\mathbf{v}_{i}^{\prime},\mathbf{v}_{j}^{% \prime})\in\varepsilon}\left\lVert\phi(\mathbf{v}_{i}^{\prime})-\phi(\mathbf{v% }_{j}^{\prime})\right\rVert_{2}}\Big{)}^{2}caligraphic_L start_POSTSUBSCRIPT italic_e italic_d italic_g italic_e end_POSTSUBSCRIPT = divide start_ARG 1 end_ARG start_ARG ∣ italic_ε ∣ end_ARG ∑ start_POSTSUBSCRIPT ( bold_v start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT , bold_v start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ) ∈ italic_ε end_POSTSUBSCRIPT ( divide start_ARG ∥ bold_v start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT - bold_v start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT end_ARG start_ARG roman_max start_POSTSUBSCRIPT ( bold_v start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT , bold_v start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT ) ∈ italic_ε end_POSTSUBSCRIPT ∥ bold_v start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT - bold_v start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT end_ARG - divide start_ARG ∥ italic_ϕ ( bold_v start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ) - italic_ϕ ( bold_v start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT ) ) ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT end_ARG start_ARG roman_max start_POSTSUBSCRIPT ( bold_v start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT , bold_v start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT ) ∈ italic_ε end_POSTSUBSCRIPT ∥ italic_ϕ ( bold_v start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT ) - italic_ϕ ( bold_v start_POSTSUBSCRIPT italic_j end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT ) ∥ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT end_ARG ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT (7)

where ϵitalic-ϵ\epsilonitalic_ϵ is the edges represented as a set of two vertex coordinates comprising each edge, and ϕ(𝐯i)italic-ϕsubscript𝐯𝑖\phi(\mathbf{v}_{i})italic_ϕ ( bold_v start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ) represents an arbitrary displacement of each vertex. This term encourages similar edge length ratios before and after the mesh deformation.

Conventional registration

For fair comparisons with DeepCarve, the conventional registration algorithm was chosen to perform fully automated registration, potentially with an offline model training component to help identify the target structure. To that end, registration algorithms that require any amount of manual annotations at test-time were excluded. For the offline model training, the models were additionally restricted to use a similar level of structural information as DeepCarve, i.e. surface mesh or segmentation.

Under these constraints, we followed a common approach that splits the registration into two steps: (1) automated segmentation and (2) segmentation-based template registration  (?, ?, ?). For the former, a deep learning model was trained to perform multilabel segmentation of the aorta, LV myocardium, and AV leaflets. The training loss was defined as the weighted sum of the Dice similarity coefficient (DSC)  (?)

DSC=n=1Nαn[2ipigiipi+igi]nsubscript𝐷𝑆𝐶superscriptsubscript𝑛1𝑁subscript𝛼𝑛subscriptdelimited-[]2subscript𝑖subscript𝑝𝑖subscript𝑔𝑖subscript𝑖subscript𝑝𝑖subscript𝑖subscript𝑔𝑖𝑛\mathcal{L}_{DSC}=\sum_{n=1}^{N}\alpha_{n}\Bigg{[}\frac{2\sum_{i}p_{i}g_{i}}{% \sum_{i}p_{i}+\sum_{i}g_{i}}\Bigg{]}_{n}caligraphic_L start_POSTSUBSCRIPT italic_D italic_S italic_C end_POSTSUBSCRIPT = ∑ start_POSTSUBSCRIPT italic_n = 1 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_N end_POSTSUPERSCRIPT italic_α start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT [ divide start_ARG 2 ∑ start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT italic_p start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT italic_g start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT end_ARG start_ARG ∑ start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT italic_p start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT + ∑ start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT italic_g start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT end_ARG ] start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT (8)

where αnsubscript𝛼𝑛\alpha_{n}italic_α start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT is the component-specific weight, and the bracketed entry is the DSC of the nthsuperscript𝑛thn^{\textrm{th}}italic_n start_POSTSUPERSCRIPT th end_POSTSUPERSCRIPT structural component. pisubscript𝑝𝑖p_{i}italic_p start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT and gisubscript𝑔𝑖g_{i}italic_g start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT are the predicted and ground-truth segmentations, respectively, at the ithsuperscript𝑖thi^{\textrm{th}}italic_i start_POSTSUPERSCRIPT th end_POSTSUPERSCRIPT voxel. For training the segmentation model, we chose uniform weighting of αnsubscript𝛼𝑛\alpha_{n}italic_α start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT to ensure equal amount of optimization for delineating all five structural components.

We maintained almost an identical training procedure to DeepCarve, such as the neural network architecture, training augmentation, and optimizer. For training and validation, we used the intermediate segmentation labels that we generated during the ground-truth surface labeling workflow.

Then, using the multilabel segmentation output, component-aware registration was performed using the weighted sum of the DSC as the overall spatial accuracy objective. We first performed similarity transformation (rotation, translation, and anisotropic scaling), and subsequently performed nonrigid deformation to fit each component of the template mesh to the predicted segmentation, similar to  (?, ?). Since no regularizations were needed for the similarity transformation, the similarity registration loss was defined as

sim=DSCwith differentαnsubscript𝑠𝑖𝑚subscript𝐷𝑆𝐶with differentsubscript𝛼𝑛\mathcal{L}_{sim}=\mathcal{L}_{DSC}\;\;\textrm{with different}\;\alpha_{n}caligraphic_L start_POSTSUBSCRIPT italic_s italic_i italic_m end_POSTSUBSCRIPT = caligraphic_L start_POSTSUBSCRIPT italic_D italic_S italic_C end_POSTSUBSCRIPT with different italic_α start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT (9)

where αn={5,1,1,1,1}subscript𝛼𝑛51111\alpha_{n}=\{5,1,1,1,1\}italic_α start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT = { 5 , 1 , 1 , 1 , 1 } to allow the largest structure, the LV, to most heavily influence the similarity registration outcome. Separate Adam optimizers  (?) were used for the scaling, rotation, and scaling parameters, with learning rates of 1e-1, 1e-1, and 1, respectively.

For non-rigid registration, the deformation field was regularized using the popular bending energy  (?), and additionally optimized for the mesh edge length loss to improve the overall mesh quality. The deformation field was constrained to be b-spline  (?, ?) with isotropic control point spacing of 3 voxels and diffeomorphic  (?, ?), similar to the deformation from DeepCarve. The final non-rigid registration loss was defined as

non-rigid=DSC+λ1bending+λ2edgesubscript𝑛𝑜𝑛-𝑟𝑖𝑔𝑖𝑑subscript𝐷𝑆𝐶subscript𝜆1subscript𝑏𝑒𝑛𝑑𝑖𝑛𝑔subscript𝜆2subscript𝑒𝑑𝑔𝑒\mathcal{L}_{non\textrm{-}rigid}=\mathcal{L}_{DSC}+\lambda_{1}\mathcal{L}_{% bending}+\lambda_{2}\mathcal{L}_{edge}caligraphic_L start_POSTSUBSCRIPT italic_n italic_o italic_n - italic_r italic_i italic_g italic_i italic_d end_POSTSUBSCRIPT = caligraphic_L start_POSTSUBSCRIPT italic_D italic_S italic_C end_POSTSUBSCRIPT + italic_λ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT caligraphic_L start_POSTSUBSCRIPT italic_b italic_e italic_n italic_d italic_i italic_n italic_g end_POSTSUBSCRIPT + italic_λ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT caligraphic_L start_POSTSUBSCRIPT italic_e italic_d italic_g italic_e end_POSTSUBSCRIPT (10)

where the DSCsubscript𝐷𝑆𝐶\mathcal{L}_{DSC}caligraphic_L start_POSTSUBSCRIPT italic_D italic_S italic_C end_POSTSUBSCRIPT was calculated with uniform αnsubscript𝛼𝑛\alpha_{n}italic_α start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT to ensure accurate matching of every component, and λi={1e2,1}subscript𝜆𝑖1𝑒21\lambda_{i}=\{1e-2,1\}italic_λ start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT = { 1 italic_e - 2 , 1 } via hyperparameter optimization. bendingsubscript𝑏𝑒𝑛𝑑𝑖𝑛𝑔\mathcal{L}_{bending}caligraphic_L start_POSTSUBSCRIPT italic_b italic_e italic_n italic_d italic_i italic_n italic_g end_POSTSUBSCRIPT is defined as the following:

bending=1V0X0Y0Z[\displaystyle\mathcal{L}_{bending}=\dfrac{1}{V}\int\limits_{0}^{X}\int\limits_% {0}^{Y}\int\limits_{0}^{Z}\bigg{[}caligraphic_L start_POSTSUBSCRIPT italic_b italic_e italic_n italic_d italic_i italic_n italic_g end_POSTSUBSCRIPT = divide start_ARG 1 end_ARG start_ARG italic_V end_ARG ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_X end_POSTSUPERSCRIPT ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_Y end_POSTSUPERSCRIPT ∫ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_Z end_POSTSUPERSCRIPT [ (2ϕx2)2+(2ϕy2)2+(2ϕz2)2superscriptsuperscript2italic-ϕsuperscript𝑥22superscriptsuperscript2italic-ϕsuperscript𝑦22superscriptsuperscript2italic-ϕsuperscript𝑧22\displaystyle\left(\dfrac{\partial^{2}\phi}{\partial x^{2}}\right)^{2}+\left(% \dfrac{\partial^{2}\phi}{\partial y^{2}}\right)^{2}+\left(\dfrac{\partial^{2}% \phi}{\partial z^{2}}\right)^{2}( divide start_ARG ∂ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_ϕ end_ARG start_ARG ∂ italic_x start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + ( divide start_ARG ∂ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_ϕ end_ARG start_ARG ∂ italic_y start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + ( divide start_ARG ∂ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_ϕ end_ARG start_ARG ∂ italic_z start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT end_ARG ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT (11)
+2(2ϕxy)2+2(2ϕxz)2+2(2ϕyz)2]dxdydz\displaystyle+2\left(\dfrac{\partial^{2}\phi}{\partial xy}\right)^{2}+2\left(% \dfrac{\partial^{2}\phi}{\partial xz}\right)^{2}+2\left(\dfrac{\partial^{2}% \phi}{\partial yz}\right)^{2}\bigg{]}\;dx\;dy\;dz+ 2 ( divide start_ARG ∂ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_ϕ end_ARG start_ARG ∂ italic_x italic_y end_ARG ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 2 ( divide start_ARG ∂ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_ϕ end_ARG start_ARG ∂ italic_x italic_z end_ARG ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + 2 ( divide start_ARG ∂ start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT italic_ϕ end_ARG start_ARG ∂ italic_y italic_z end_ARG ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT ] italic_d italic_x italic_d italic_y italic_d italic_z

where V𝑉Vitalic_V is the number of voxels and ϕitalic-ϕ\phiitalic_ϕ is the voxelwise deformation field. edgesubscript𝑒𝑑𝑔𝑒\mathcal{L}_{edge}caligraphic_L start_POSTSUBSCRIPT italic_e italic_d italic_g italic_e end_POSTSUBSCRIPT is identical to the definition in the DeepCarve training details section. The Adam optimizer  (?) with a learning rate of 1e-2 was used for the deformation field optimization.

The conventional registration method was implemented in-house, mostly due to the lack of compatibility of existing libraries with our specific task. We required the methods to simultaneously register five different potentially overlap** segmentations and maintain reasonable mesh qualities for all components, both of which were difficult to enforce in standard registration libraries. Our implementation was carefully optimized for performance, while following the standard approaches for the deformation and regularization formulations found in the literature and software libraries.

Conventional calcification modeling

For conventional modeling, the calcification was implemented as element-specific assignment of stiffer material properties, similar to  (?, ?). The desired calcification elements were selected using the post-processed segmentation of C-MAC, the same geometry that was used to perform the final calcification meshing. The calcification segmentation value was trilinearly interpolated at each node of the conventionally registered mesh, and any elements with at least one node with an interpolated nodal segmentation value of >>>0.5 were assigned stiffer material properties.

Geometric evaluation metrics and statistical analyses

The normalized symmetric chamfer distance was used to evaluate the average surface accuracy of the reconstructed meshes. The mathematical definition is ch2subscript𝑐2\frac{\mathcal{L}_{ch}}{2}divide start_ARG caligraphic_L start_POSTSUBSCRIPT italic_c italic_h end_POSTSUBSCRIPT end_ARG start_ARG 2 end_ARG, where the division normalizes the chamfer distance that is calculated twice in both directions (i.e. prediction \rightarrow label and label \rightarrow prediction). The scaled jacobian determinant and skew were obtained using the VTK library  (?). The metrics were first calculated for each component for each patient, and then combined across component groups via the weighted average using the number of points/elements as weights. The mean, standard deviation, and statistical significance were calculated from the patient-specific component-grouped metrics. This evaluation method is identical to DeepCarve. For statistical analyses, paired t-tests with two-sided alternative hypothesis were performed using the SciPy package  (?).

3D printing mesh conversion algorithms

For all structural components, the final operations for 3D printing mesh conversion were (1) isosurface extraction from voxelgrid representations, (2) remeshing, and (3) mesh smoothing. The isosurface extraction and mesh smoothing were performed using VTK  (?) and remeshing using ACVD  (?). Since all of these automated operations can be robustly performed with reasonable input geometry and algorithmic parameters, the crux of the conversion process was obtaining an accurate voxelgrid representation for each component.

For calcification, the post-processed segmentation from C-MAC was used for the conversion. Since the post-processed segmentation was already at a high enough voxelgrid resolution of 0.33mm isotropic spacing to capture the contact surfaces, the extracted surfaces maintained great overlap** spatial relationships with its surrounding geometry.

For the leaflets, the surface of each leaflet hexahedral mesh was first extracted, and then converted to the corresponding segmentation using the image stencil operation. The segmentation was obtained at an isotropic 0.25mm voxel spacing to account for the thin structure of the leaflets and to allow for precise control over the final mesh thickness. The segmentation was converted to the SDF representation using SciPy’s distance transform package  (?), and then the final post-processed segmentation was obtained for meshing by variably thresholding the calculated voxelgrid distances. The thresholds were chosen mostly to thicken the leaflets, as the original thickness was often incompatible with the hardware limitations of 3D printers.

The conversion of the aorta and LV inner wall involved a similar process of map** a closed surface mesh into segmentation, converting it to an SDF representation, obtaining a new thickness-adjusted segmentation, and performing the component-agnostic meshing operations. The SDF voxelgrid resolution was set at an isotropic 0.5mm spacing.

In addition to these steps, the aorta and LV were combined at two different cardiac phases to design the optimal geometry for our benchtop experiments. More specifically, the systolic aorta and the diastolic LV were combined to accurately model the valve opening and the most relaxed LV structure. From the DeepCarve outputs at both phases, the inner walls of the desired structures at each phase were extracted utilizing the template element information. With a naïve combination of those meshes using the canonical coordinate system, the initial merge is almost guaranteed to be inaccurate due to the global movements of those structures throughout the cardiac cycle (Fig. 3C, Initial merge).

Thus, a mesh displacement optimization was further performed to correct for these inconsistencies. The overall idea is to designate a small amount of transition elements in between the aorta and LV and allow those elements to be non-rigidly deformed, while only rigidly transforming the rest of the aorta and LV elements. The following equation was used to maintain a reasonable quality of the transition elements

=λ1normal+λ2lap+λ3edgesubscript𝜆1subscript𝑛𝑜𝑟𝑚𝑎𝑙subscript𝜆2subscript𝑙𝑎𝑝subscript𝜆3subscript𝑒𝑑𝑔𝑒\mathcal{L}=\lambda_{1}\mathcal{L}_{normal}+\lambda_{2}\mathcal{L}_{lap}+% \lambda_{3}\mathcal{L}_{edge}caligraphic_L = italic_λ start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT caligraphic_L start_POSTSUBSCRIPT italic_n italic_o italic_r italic_m italic_a italic_l end_POSTSUBSCRIPT + italic_λ start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT caligraphic_L start_POSTSUBSCRIPT italic_l italic_a italic_p end_POSTSUBSCRIPT + italic_λ start_POSTSUBSCRIPT 3 end_POSTSUBSCRIPT caligraphic_L start_POSTSUBSCRIPT italic_e italic_d italic_g italic_e end_POSTSUBSCRIPT (12)

where all loss components were defined previously, and λi={10,1,10}subscript𝜆𝑖10110\lambda_{i}=\{10,1,10\}italic_λ start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT = { 10 , 1 , 10 }. The deformation field for the transition elements was identical to the deformation fields for the conventional registration and DeepCarve. Separate Adam optimizers were used with learning rates of 1e-3 and 3e-2 for non-rigid and rigid transformations, respectively.

Note that the inner wall mesh was the input to the subsequent segmentation and SDF conversions, so its quality was not critical to the final 3D printing mesh. However, a reasonable quality of the combined mesh was still required to ensure robust performance of the image stencil operation for the intermediate voxelgrid segmentation.

Finite element model of patient-specific anatomies

Three-dimensional LV, aorta, valve, and calcium geometries were obtained as direct output from the multi-frame meshing approach. The three-dimensional LV and aorta geometry were further extended using solid modeling computer-aided design (CAD) software (SolidWorks 2023, Dassault Systèmes) to improve the flow convergence and stability. The extended inlet connected to LV represented the flow entrance from LA and LV during the cardiac cycle. The generated geometries were imported into Abaqus 2022 software (Simulia, Dassault Systèmes). Nonlinear explicit dynamic analysis was performed to simulate the mechanical response of the FSI analysis. For this study, the modified anisotropic hyperelastic Holzapfel–Gasser–Ogden material model  (?, ?) was adopted to characterize the mechanical behavior of native AV leaflets. Local coordinate systems were defined for each leaflet to include local fiber orientation. We assumed that the mean fiber directions were symmetric with respect to the circumferential axis of the local coordinate system (Fig. S3). Specific material constants were utilised for calcium, as previously outlined in the literature. Isotropic linear elastic model was implemented to characterize the mechanical properties of the calcium deposits. The nodal points of the calcium elements were tied to leaflets at the intersection of the leaflet surface. In the instance of conventional registration, only those leaflet surface areas in contact with calcium were identified and assigned the mechanical properties of the calcium deposits, without being reconstructed three-dimensionally.

Fluid-Structure Interaction Modeling

FSI modeling technique was utilized to simulate intravascular hemodynamic interactions with the deformable valve structure. The fluid domain was spatially discreted, and governing equations for both the fluid and structure were solved separately for each discrete time step. The flow patterns in the LV and aorta were simulated using a commercial fluid solver package (XFlow 2022x, Dassault Systèmes), utilizing a Large-Eddy Simulation (LES) turbulence model. The fluid-structure system is represented using the immersed finite element/finite difference method to avoid issues related to mesh motion and mesh regeneration resulting from significant deformations. A method including iterative implicit 1-way and 2-way coupling was used to compute the numerical FSI problems. The 1-way coupling approach is employed to model the cardiac motion for individual patients, where the nodal displacement is prescribed to the LV mesh using our multi-frame image registration framework. An iterative 2-way coupling method is then used to simulate flow interaction between the fluid domain and the valve structure. The blood was mathematically treated as an incompressible Newtonian fluid with a density of 1050 kg/m3 and a dynamic viscosity of 0.0035 Pa s. The inlet flow boundary condition for this analysis was based on a representative flow waveform derived from healthy adult physiology described in the literature  (?, ?). The outlet pressure boundary condition at the aorta was set based on blood pressure readings taken during a pre-TAVR transthoracic echo examination. The duration of the cardiac cycle for each patient was determined by the heart rate measured during the pre-TAVR echo testing. Overall three cardiac cycles were simulated and their results were analyzed, taking into account that the difference in observed physical quantities was less than five between the cycles. The stable time increment was established at 1×10-5s to ensure numerical stability and temporal accuracy. Grid independence was assessed on the first patient model by employing three distinct grid sizes (0.8mm, 0.6mm, and 0.4mm lattice resolution). The stability measure converged with a 4.42% difference between the medium and fine grids, indicating that the medium grid (0.6 mm resolution, 510,000 elements) was considered to be grid-independent. Each FSI simulation was completed in 30.6 hours (3 cardiac cycles) on a desktop PC with a 3.0 GHZ i7-9700 processor with 8 cores and 32 GB RAM.

Experimental study design

In vitro validation was conducted on a subset of patients (patients 1 and 2) selected based on differences in their severity of AS. The experimental setup used in this work was analogous to that previously published by our group  (?). We employed a custom soft robotic LV sleeve that mimics the beating motion of the heart using 3D printed geometry. The soft robotic LV contracts pneumatically to pump fluid, causing the valve to move during systole. We created the patient’s artificial anatomy, specifically the LV sleeve, and conducted hemodynamic evaluation using a hydrodynamic flow loop. The 3D-printed anatomical model of each patient was combined with the LV sleeve in a hydrodynamic flow loop. Hemodynamic parameters related to AS were assessed using continuous wave and color flow map** Doppler. Results were compared with the clinical transthoracic echocardiogram data of the patients.

Manufacturing of patient-specific heart and sleeve

The 3D anatomy of the LV, aorta (ascending segment), AV leaflets, and calcium were exported in shell stereolithography (STL) format for each patient using our 3D printing mesh conversion technique. The generated STLs of aortic leaflets and the calcium geometry were integrated with the aorta and LV using a Boolean merging operation. The combined STL file was imported into Preform software (v3.21, Formlabs), and the support material’s structure was manually altered to optimize the printability and the amount of internal support material. The LV, aorta, AV leaflets, and calcium were printed simultaneously on a Form 3B STL 3D printer (Formlabs) with a layer thickness of 0.1 mm and a wall thickness of 1.3 mm

A soft robotic LV sleeve made of inflatable Thermoplastic Polyurethane (TPU) pockets wrapped around the LV anatomy was used to actuate the system. Patient-specific sleeves were initially created utilizing computer-aided software (SolidWorks 2023, Dassault Systèmes). The outside surface of the LV was offset by 10 mm to establish a patient-specific shape. The generated shape was then projected onto a flat surface to form the shapes of the molds for production. TPU sheets were formed using the molds and then heat-sealed to make sealed and inflatable pockets integrated into the LV sleeve based on previously described methods by our group  (?, ?).

Mock circulatory flow loop

A mock circulatory loop was created utilizing hydraulic and mechanical components to mimic the blood flow (viscosity of medium, μ𝜇\muitalic_μ = 1.0 cP) in the anatomy. The loop for each patient was created by connecting the specific 3D-printed anatomy to soft PVC plastic tubing (5/8-inch inner diameter, 1-inch outer diameter; McMasterr-Carr), two variable-resistance ball valves to simulate arterial and venous resistance, and custom-made acrylic compliance chambers to represent peripheral compliance. The LV sleeve was connected to a control box with pressure regulators and actuated using input-pressure square waveforms ranging from 0 psi (diastole) to 10 psi (systole), with a duty cycle of 30-50% and a heart rate of 40-60 bpm. The sleeve was connected in series to adjustable resistance valves and compliance chambers, both on the outflow and the inflow, that could be adjusted to re-create patient-specific hemodynamic states. A unidirectional mechanical valve (Regent 19AGN-751, Abbott Laboratories) was connected to simulate the function of the mitral valve.

A clamp-on flow probe (PS series, Transonic) in the position of the mitral valve and two straight-tip 5F PV catheters advanced to the LV and aortic position were used to monitor pressures and flows. The flow probes were connected to a two-channel flowmeter console (400-series, Transonic), which was connected to an 8-channel Powerlab system (ADInstruments) for data acquisition and recording. The catheters were connected to a Transonic ADV500 PV System and to the Powerlab (ADInstruments). All PV data were processed and analyzed on Matlab R2020a (MathWorks).

Echocardiography

The Epiq CVx cardiovascular ultrasound system and the X5-1 transducer (Philips) were used for echocardiographic evaluation on the physical prototypes. The transducer was positioned directly on the printed aorta and the ultrasonic beam was aligned with the direction of flow for continuous wave Doppler imaging. CW Doppler was used for the evaluation of vLVOT, vpeak and estimates of dPmax and dPmean. Dimensionless velocity index (DVI) was calculated as the ratio of the LVOT velocity and the maximum velocity obtained by CW Doppler across the aortic valve.

DVI=VLVOTVpeak𝐷𝑉𝐼𝑉LVOT𝑉peakDVI=\frac{V\textsubscript{LVOT}}{V\textsubscript{peak}}italic_D italic_V italic_I = divide start_ARG italic_V end_ARG start_ARG italic_V end_ARG (13)

Images of the LV and measurements of EDD, ESD, and dLVOT were obtained in B-mode. Estimates of LV volumes, both at ESV and EDV, were obtained using the Teicholz formula  (?):

LVV=72.4+LVID×LVID3𝐿𝑉𝑉72.4𝐿𝑉𝐼𝐷𝐿𝑉𝐼superscript𝐷3LVV=\frac{7}{2.4+LVID}\times{LVID^{3}}italic_L italic_V italic_V = divide start_ARG 7 end_ARG start_ARG 2.4 + italic_L italic_V italic_I italic_D end_ARG × italic_L italic_V italic_I italic_D start_POSTSUPERSCRIPT 3 end_POSTSUPERSCRIPT (14)

where LVV and LVID are the LV volume and internal diameter, respectively.

References

  • 1. R. Ramaraj, V. L. Sorrell, Degenerative aortic stenosis, Bmj 336, 550 (2008).
  • 2. J. B. Chambers, Aortic stenosis, European Journal of Echocardiography 10, i11 (2009).
  • 3. M. Lindroos, M. Kupari, J. Heikkilä, R. Tilvis, Prevalence of aortic valve abnormalities in the elderly: an echocardiographic study of a random population sample, Journal of the American College of Cardiology 21, 1220 (1993).
  • 4. R. V. Freeman, G. Crittenden, C. Otto, Acquired aortic stenosis, Expert review of cardiovascular therapy 2, 107 (2004).
  • 5. E. Charlson, A. T. Legedza, M. B. Hamel, Decision-making and outcomes in severe symptomatic aortic stenosis, Journal of Heart Valve Disease 15, 312 (2006).
  • 6. G. Lee, J. Chikwe, M. Milojevic, H. C. Wijeysundera, G. Biondi-Zoccai, M. Flather, M. F. Gaudino, S. E. Fremes, D. Y. Tam, Esc/eacts vs. acc/aha guidelines for the management of severe aortic stenosis, European Heart Journal 44, 796 (2023).
  • 7. R. Danielsen, T. Aspelund, T. B. Harris, V. Gudnason, The prevalence of aortic stenosis in the elderly in iceland and predictions for the coming decades: The ages–reykjavík study, International journal of cardiology 176, 916 (2014).
  • 8. G. Marquis-Gravel, B. Redfors, M. B. Leon, P. Genereux, Medical treatment of aortic stenosis, Circulation 134, 1766 (2016).
  • 9. G. Benfari, M.-A. Clavel, S. Nistri, C. Maffeis, C. Vassanelli, M. Enriquez-Sarano, A. Rossi, Concomitant mitral regurgitation and aortic stenosis: one step further to low-flow preserved ejection fraction aortic stenosis, European Heart Journal-Cardiovascular Imaging 19, 569 (2018).
  • 10. A. Slimani, J. Melchior, C. de Meester, S. Pierard, C. Roy, M. Amzulescu, C. Bouzin, F. Maes, A. Pasquet, A.-C. Pouleur, et al., Relative contribution of afterload and interstitial fibrosis to myocardial function in severe aortic stenosis, Cardiovascular Imaging 13, 589 (2020).
  • 11. E. J. Weinberg, F. J. Schoen, M. R. Mofrad, A computational model of aging and calcification in the aortic heart valve, PLoS One 4, e5960 (2009).
  • 12. J. D. Miller, R. M. Weiss, D. D. Heistad, Calcific aortic valve stenosis: methods, models, and mechanisms, Circulation research 108, 1392 (2011).
  • 13. B. A. Carabello, W. J. Paulus, Aortic stenosis, The lancet 373, 956 (2009).
  • 14. C. Otto, Acc/aha guideline for the management of patients with valvular heart disease: a report of the american college of cardiology/american heart association joint committee on clinical practice guidelines, Circulation 2021, 143 (2020).
  • 15. J. M. Brennan, F. H. Edwards, Y. Zhao, S. M. O’Brien, P. S. Douglas, E. D. Peterson, Long-term survival after aortic valve replacement among high-risk elderly patients in the united states: insights from the society of thoracic surgeons adult cardiac surgery database, 1991 to 2007, Circulation 126, 1621 (2012).
  • 16. J. JM, Repeat heart valve surgery: risk factors for operative mortality, J Thorac Cardiovasc Surg 122, 913 (2001).
  • 17. E. Bouvier, D. Logeart, J.-L. Sablayrolles, J. Feignoux, C. Scheublé, T. Touche, G. Thabut, A. Cohen-Solal, Diagnosis of aortic valvular stenosis by multislice cardiac computed tomography, European heart journal 27, 3033 (2006).
  • 18. T. Pflederer, S. Achenbach, Aortic valve stenosis: Ct contributions to diagnosis and therapy, Journal of Cardiovascular Computed Tomography 4, 355 (2010).
  • 19. N. Saikrishnan, G. Kumar, F. J. Sawaya, S. Lerakis, A. P. Yoganathan, Accurate assessment of aortic stenosis: a review of diagnostic modalities and hemodynamics, Circulation 129, 244 (2014).
  • 20. C. Dowling, A. M. Bavo, N. El Faquir, P. Mortier, P. De Jaegere, O. De Backer, L. Sondergaard, P. Ruile, D. Mylotte, H. McConkey, et al., Patient-specific computer simulation of transcatheter aortic valve replacement in bicuspid aortic valve morphology, Circulation: Cardiovascular Imaging 12, e009178 (2019).
  • 21. G. M. Bosi, C. Capelli, M. H. Cheang, N. Delahunty, M. Mullen, A. M. Taylor, S. Schievano, A validated computational framework to predict outcomes in tavi, Scientific reports 10, 9906 (2020).
  • 22. O. M. Rotman, B. Kovarovic, C. Sadasivan, L. Gruberg, B. B. Lieber, D. Bluestein, Realistic vascular replicator for tavr procedures, Cardiovascular engineering and technology 9, 339 (2018).
  • 23. A. Hosny, J. D. Dilley, T. Kelil, M. Mathur, M. N. Dean, J. C. Weaver, B. Ripley, Pre-procedural fit-testing of tavr valves using parametric modeling and 3d printing, Journal of cardiovascular computed tomography 13, 21 (2019).
  • 24. S. Morganti, M. Conti, M. Aiello, A. Valentini, A. Mazzola, A. Reali, F. Auricchio, Simulation of transcatheter aortic valve implantation through patient-specific finite element analysis: Two clinical cases, Journal of biomechanics 47, 2547 (2014).
  • 25. G. Luraghi, F. Migliavacca, A. García-González, C. Chiastra, A. Rossi, D. Cao, G. Stefanini, J. F. Rodriguez Matas, On the modeling of patient-specific transcatheter aortic valve replacement: a fluid–structure interaction approach, Cardiovascular engineering and technology 10, 437 (2019).
  • 26. D. Levin, G. B. Mackensen, M. Reisman, J. M. McCabe, D. Dvir, B. Ripley, 3d printing applications for transcatheter aortic valve replacement, Current cardiology reports 22, 1 (2020).
  • 27. A. I. Veress, G. T. Gullberg, J. A. Weiss, Measurement of strain in the left ventricle during diastole with cine-mri and deformable image registration (2005).
  • 28. B. Baillargeon, N. Rebelo, D. D. Fox, R. L. Taylor, E. Kuhl, The living heart project: a robust and integrative simulator for human heart function, European Journal of Mechanics-A/Solids 48, 38 (2014).
  • 29. V. Gurev, P. Pathmanathan, J.-L. Fattebert, H.-F. Wen, J. Magerlein, R. A. Gray, D. F. Richards, J. J. Rice, A high-resolution computational model of the deforming human heart, Biomechanics and modeling in mechanobiology 14, 829 (2015).
  • 30. S. Wald, A. Liberzon, I. Avrahami, A numerical study of the hemodynamic effect of the aortic valve on coronary flow, Biomechanics and modeling in mechanobiology 17, 319 (2018).
  • 31. L. Dedè, F. Menghini, A. Quarteroni, Computational fluid dynamics of blood flow in an idealized left human heart, International journal for numerical methods in biomedical engineering 37, e3287 (2021).
  • 32. P. Youssefi, A. Gomez, T. He, L. Anderson, N. Bunce, R. Sharma, C. A. Figueroa, M. Jahangiri, Patient-specific computational fluid dynamics—assessment of aortic hemodynamics in a spectrum of aortic valve pathologies, The Journal of thoracic and cardiovascular surgery 153, 8 (2017).
  • 33. N. Kimura, M. Nakamura, K. Komiya, S. Nishi, A. Yamaguchi, O. Tanaka, Y. Misawa, H. Adachi, K. Kawahito, Patient-specific assessment of hemodynamics by computational fluid dynamics in patients with bicuspid aortopathy, The Journal of Thoracic and Cardiovascular Surgery 153, S52 (2017).
  • 34. L. Rosalia, C. Ozturk, J. Coll-Font, Y. Fan, Y. Nagata, M. Singh, D. Goswami, A. Mauskapf, S. Chen, R. A. Eder, et al., A soft robotic sleeve mimicking the haemodynamics and biomechanics of left ventricular pressure overload and aortic stenosis, Nature biomedical engineering 6, 1134 (2022).
  • 35. L. Rosalia, C. Ozturk, D. Goswami, J. Bonnemain, S. X. Wang, B. Bonner, J. C. Weaver, R. Puri, S. Kapadia, C. T. Nguyen, et al., Soft robotic patient-specific hydrodynamic model of aortic stenosis and ventricular remodeling, Science Robotics 8, eade2184 (2023).
  • 36. M. D. Hope, T. A. Hope, A. K. Meadows, K. G. Ordovas, T. H. Urbania, M. T. Alley, C. B. Higgins, Bicuspid aortic valve: four-dimensional mr evaluation of ascending aortic systolic flow patterns, Radiology 255, 53 (2010).
  • 37. A. Ducci, S. Tzamtzis, M. J. Mullen, G. Burriesci, Hemodynamics in the valsalva sinuses after transcatheter aortic valve implantation (tavi), J Heart Valve Dis 22, 688 (2013).
  • 38. K. Vahidkhah, M. Barakat, M. Abbasi, S. Javani, P. N. Azadani, A. Tandar, D. Dvir, A. N. Azadani, Valve thrombosis following transcatheter aortic valve replacement: significance of blood stasis on the leaflets, European Journal of Cardio-Thoracic Surgery 51, 927 (2017).
  • 39. D. H. Pak, M. Liu, T. Kim, L. Liang, A. Caballero, J. Onofrey, S. S. Ahn, Y. Xu, R. McKay, W. Sun, et al., Patient-specific heart geometry modeling for solid biomechanics using deep learning, IEEE transactions on medical imaging (2023).
  • 40. D. H. Pak, M. Liu, T. Kim, C. Ozturk, R. McKay, E. T. Roche, R. Gleason, J. S. Duncan, Robust automated calcification meshing for biomechanical cardiac digital twins, arXiv preprint arXiv:2403.04998 (2024).
  • 41. W. Sun, C. Martin, T. Pham, Computational modeling of cardiac valve function and intervention, Annual review of biomedical engineering 16, 53 (2014).
  • 42. T. Qin, W. Mao, A. Caballero, N. Kamioka, S. Lerakis, S. Lain, J. Elefteriades, L. Liang, W. Sun, Patient-specific analysis of bicuspid aortic valve hemodynamics using a fully coupled fluid-structure interaction model, Computers in Biology and Medicine p. 108191 (2024).
  • 43. F. Kong, S. C. Shadden, Learning whole heart mesh generation from patient images for computational simulations, IEEE Transactions on Medical Imaging 42, 533 (2022).
  • 44. B. J. Kovarovic, O. M. Rotman, P. Parikh, M. J. Slepian, D. Bluestein, Patient-specific in vitro testing for evaluating tavr clinical performance—a complementary approach to current iso standard testing, Artificial organs 45, E41 (2021).
  • 45. X. Zhuang, J. Shen, Multi-scale patch and multi-modality atlases for whole heart segmentation of mri, Medical image analysis 31, 77 (2016).
  • 46. D. H. Pak, M. Liu, S. S. Ahn, A. Caballero, J. A. Onofrey, L. Liang, W. Sun, J. S. Duncan, Information Processing in Medical Imaging: 27th International Conference, IPMI 2021, Virtual Event, June 28–June 30, 2021, Proceedings 27 (Springer, 2021), pp. 637–648.
  • 47. D. H. Pak, M. Liu, T. Kim, L. Liang, R. McKay, W. Sun, J. S. Duncan, Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part VI 24 (Springer, 2021), pp. 485–494.
  • 48. D. P. Kingma, J. Ba, Adam: A method for stochastic optimization, arXiv preprint arXiv:1412.6980 (2014).
  • 49. N. Wang, Y. Zhang, Z. Li, Y. Fu, W. Liu, Y.-G. Jiang, Proceedings of the European Conference on Computer Vision (ECCV) (2018), pp. 52–67.
  • 50. T. Kim, D. Eberle, ACM SIGGRAPH 2020 Courses (2020), pp. 1–182.
  • 51. G. Gkioxari, J. Malik, J. Johnson, Proceedings of the IEEE International Conference on Computer Vision (2019), pp. 9785–9795.
  • 52. M. Astorino, J. Hamers, S. C. Shadden, J.-F. Gerbeau, A robust and efficient valve model based on resistive immersed surfaces, International Journal for Numerical Methods in Biomedical Engineering 28, 937 (2012).
  • 53. V. Tavakoli, A. A. Amini, A survey of shaped-based registration and segmentation techniques for cardiac images, Computer Vision and Image Understanding 117, 966 (2013).
  • 54. A. M. Pouch, S. Tian, M. Takebe, J. Yuan, R. Gorman Jr, A. T. Cheung, H. Wang, B. M. Jackson, J. H. Gorman III, R. C. Gorman, et al., Medially constrained deformable modeling for segmentation of branching medial structures: Application to aortic valve segmentation and morphometry, Medical image analysis 26, 217 (2015).
  • 55. D. H. Pak, A. Caballero, W. Sun, J. S. Duncan, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI) (IEEE, 2020), pp. 1738–1742.
  • 56. X. Papademetris, M. P. Jackowski, N. Rajeevan, M. DiStasio, H. Okuda, R. T. Constable, L. H. Staib, Bioimage suite: An integrated medical image analysis suite: An update, The insight journal 2006, 209 (2006).
  • 57. D. Rueckert, L. I. Sonoda, C. Hayes, D. L. Hill, M. O. Leach, D. J. Hawkes, Nonrigid registration using free-form deformations: application to breast mr images, IEEE transactions on medical imaging 18, 712 (1999).
  • 58. R. Sandkühler, C. Jud, S. Andermatt, P. C. Cattin, Airlab: Autograd image registration laboratory, arXiv preprint arXiv:1806.09907 (2018).
  • 59. A. V. Dalca, G. Balakrishnan, J. Guttag, M. R. Sabuncu, International Conference on Medical Image Computing and Computer-Assisted Intervention (Springer, 2018), pp. 729–738.
  • 60. M. Loureiro-Ga, C. Veiga, G. Fdez-Manin, V. A. Jimenez, F. Calvo-Iglesias, A. Iniguez, A biomechanical model of the pathological aortic valve: simulation of aortic stenosis, Computer Methods in Biomechanics and Biomedical Engineering 23, 303 (2020).
  • 61. W. Schroeder, K. M. Martin, W. E. Lorensen, The visualization toolkit an object-oriented approach to 3D graphics (Prentice-Hall, Inc., 1998).
  • 62. P. Virtanen, R. Gommers, T. E. Oliphant, M. Haberland, T. Reddy, D. Cournapeau, E. Burovski, P. Peterson, W. Weckesser, J. Bright, S. J. van der Walt, M. Brett, J. Wilson, K. J. Millman, N. Mayorov, A. R. J. Nelson, E. Jones, R. Kern, E. Larson, C. J. Carey, İ. Polat, Y. Feng, E. W. Moore, J. VanderPlas, D. Laxalde, J. Perktold, R. Cimrman, I. Henriksen, E. A. Quintero, C. R. Harris, A. M. Archibald, A. H. Ribeiro, F. Pedregosa, P. van Mulbregt, SciPy 1.0 Contributors, SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python, Nature Methods 17, 261 (2020).
  • 63. S. Valette, J. M. Chassery, R. Prost, Generic remeshing of 3d triangular meshes with metric-dependent discrete voronoi diagrams, IEEE Transactions on Visualization and Computer Graphics 14, 369 (2008).
  • 64. G. A. Holzapfel, T. C. Gasser, R. W. Ogden, A new constitutive framework for arterial wall mechanics and a comparative study of material models, Journal of elasticity and the physical science of solids 61, 1 (2000).
  • 65. T. C. Gasser, R. W. Ogden, G. A. Holzapfel, Hyperelastic modelling of arterial layers with distributed collagen fibre orientations, Journal of the royal society interface 3, 15 (2006).
  • 66. D. K. Panesar, M. Burch, Assessment of diastolic function in congenital heart disease, Frontiers in Cardiovascular Medicine 4 (2017).
  • 67. W. R. Milnor, Hemodynamics, Cardiac dynamics (1989).
  • 68. L. Rosalia, C. Ozturk, S. X. Wang, D. Quevedo-Moreno, M. Y. Saeed, A. Mauskapf, E. T. Roche, Modulating cardiac hemodynamics using tunable soft robotic sleeves in a porcine model of hfpef physiology for device testing applications, Advanced Functional Materials 34, 2310085 (2024).
  • 69. L. E. Teichholz, T. Kreulen, M. V. Herman, R. Gorlin, Problems in echocardiographic volume determinations: echocardiographic-angiographic correlations in the presence or absence of asynergy, The American journal of cardiology 37, 7 (1976).

Acknowledgments

We acknowledge funding from multiple organizations, the National Science Foundation (NSF) grant 1847541 (to ETR), the Additional Ventures Single Ventricle Research Fund (to ETR), the National Institute of Health (NIH), National Heart, Lung, and Blood Institute (NHLBI) grant F31HL16250 (to DHP), grants R01HL121226, R01HL142036, and T32HL098069 (to JSD), grants R01EB033853, R01HL151704 and R01HL159010 (to CTN). Parts of some figures were created using BioRender, Adobe Illustrator, and OriginPro 2021b software.

Author contributions

CO, DHP, JSD, and ETR designed the concept, CO and DHP performed computational investigation and analysis, CO, LR, MER and DG performed benchtop experiments, RM provided the dataset, CO, DHP, LR, DG, CTN, JSD, and ETR wrote or revised the manuscript, CTN, JSD and ETR provided funding and supervision.

Competing interests

ETR is a member of the board of directors at Affluent Medical and also serves on the board of advisors for Pumpinheart and Helios Cardio. ETR offers consulting services for Holistick Medical and is a co-founder of Spheric Bio and Fada Medical. A provisional patent No. 63/611,903 was filed for the C-MAC algorithm (DHP). The other authors declare that they have no competing interests.

List of Supplementary Materials

Fig. S1 to S5

Movie S1 to S5