ROM inversion of monostatic data lifted to full MIMO.
Abstract
The Lippmann–Schwinger–Lanczos (LSL) algorithm has recently been shown to provide an efficient tool for imaging and direct inversion of synthetic aperture radar data in multi-scattering environments [17], where the data set is limited to the monostatic, a.k.a. single input/single output (SISO) measurements. The approach is based on constructing data-driven estimates of internal fields via a reduced-order model (ROM) framework and then plugging them into the Lippmann-Schwinger integral equation. However, the approximations of the internal solutions may have more error due to missing the off diagonal elements of the multiple input/multiple output (MIMO) matrix valued transfer function. This, in turn, may result in multiple echoes in the image. Here we present a ROM-based data completion algorithm to mitigate this problem. First, we apply the LSL algorithm to the SISO data as in [17] to obtain approximate reconstructions as well as the estimate of internal field. Next, we use these estimates to calculate a forward Lippmann-Schwinger integral to populate the missing off-diagonal data (the lifting step). Finally, to update the reconstructions, we solve the Lippmann-Schwinger equation using the original SISO data, where the internal fields are constructed from the lifted MIMO data. The steps of obtaining the approximate reconstructions and internal fields and populating the missing MIMO data entries can be repeated for complex models to improve the images even further. Efficiency of the proposed approach is demonstrated on 2D and 2.5D numerical examples, where we see reconstructions are improved substantially.
1 Introduction
Although the Born approximation and linear sampling methods [11, 10] are methods of choice for synthetic aperture radar (SAR) due to their speed and versatility, nonlinear scattering is known to produce significant artifacts. Approaches to deal with multiple scattering include optimization [21], improved linearizations using some knowledge of an inhomogeneous background [18, 27], statistical and machine learning methods [22], iterative time reversal and matching filtering [20], and reweighting [12]. Also in seismic imaging are full wave inversion [26], boundary control [19], and inverse series methods [23]. Many of the above approaches require prior knowledge, the solution of full scale forward problems or large training sets.
Reduced order model (ROM) approaches have been shown to provide accurate images for several inverse impedance, scattering and diffusion problems [3, 5, 14, 13, 6, 7, 4, 2, 15, 9, 16, 8]. In the recent work [17], we applied the Lippmann-Schwinger-Lanczos algorithm [15] to models of synthetic aperture radar. Most of the ROM-based imaging approaches strongly rely on having a complete square MIMO dataset accessible, as seen in the schematic (1)
(1) |
where the column and row numbers correspond respectively to the indices of the receivers (outputs) and transmitters (inputs). The other half of the transfer matrix extends by reciprocity. In SAR, as well as in conventional (non-array) medical ultrasound, profiling is done by mono-static transmitter/receivers, and images are constructed by combining multiple single-input/single output (SISO) data. The data in this case is visualized in (2),
(2) |
where we have only the diagonal. The nature of the Lippmann-Schwinger-Lanczos (LSL) algorithm allowed us to extend the ROM approach naturally to this case in [17]. LSL for monostatic data [17] contains two major steps:
-
•
Step (i) Use the individual SISO ROMs to generate internal fields
-
•
Step (ii) Use these internal fields to linearize the Lippmann-Schwinger equation and solve for the profile.
Using this method we were able to substantially reduce the echos compared to the Born approximation, with minimal increase to the computational cost. However, due to the lack of the off diagonal data, we did not have the full strength of the MIMO ROM, and so the data generated internal fields were less accurate. In this work we propose to use the SISO ROMs to lift the data to improve the data generated internal fields. We start by first implementing LSL for monostatic data. Once we have approximate internal fields and profile, we do a forward application of the Lippmann-Schwinger integral to approximate the off-diagonals. That is, we complete the data so that it is of the form (3)
(3) |
where the symbol represents approximate, or lifted, data. With a full (yet approximate) transfer matrix in hand, we can use a MIMO ROM to construct improved internal fields, for a new Step (i). These improved fields are then used in the Lippmann Schwinger equation in Step (ii). Evidently, at Step (ii), we use only the true diagonal data, since the lifted off diagonals will not provide any new information.
We note that the lifted data matrix (3) does not have the correct structure apriori, that is to say, the resulting mass matrix may not be symmetric positive definite. Regularization will therefore be necessary at this step separately, in addition to the usual regularization required for the inversion of the Lippmann-Schwinger equation. We also emphasize that lifting doesn’t provide additional data for the inverse problem; it is used solely to improve the ROM’s performance in generating the internal fields.
We now make a remark about ROM based inversion methods. In general, a complete ROM is a reduced version of the full scale PDE in the form of a Galerkin system, containing both a mass matrix (the Grammian used here) and a stiffness matrix. Historically, the complete reduced order model was needed to do inversion (see for example [14]). It was later found that in the time domain the stiffness matrix was not needed for the LSL approach, hence in this work we discuss only , and refer to this as the ROM.
This paper is organized as follows. In Section 2 we state precisely the model and inverse problem and give an overview of the entire process. Sections 3,4, and 5 contain detailed descriptions of the steps, which are monostatic LSL, data completion, and MIMO generation of internal fields, respectively. In Section 6 we present numerical experiments demonstrating the improved performance. We present a brief conclusion in Section 7. As a notational note, throughout the manuscript, we use boldface to denote data generated approximations while the regular script denotes actual values.
2 Statement of the inverse problem and algorithm overview
We assume the following wave model problem for a domain
(4) |
with initial conditions
(5) | |||||
(6) |
where for are Dirichlet initial conditions representing localized sources near the boundary,***The formulation for the homogeneous wave equation (4) with an inhomogeneous initial condition (5) can be equivalently derived from the more conventional radar formulation of an inhomogeneous wave equation with homogeneous initial conditions. We refer to [14] for details. and we assume homogeneous Neumann boundary conditions on the spatial boundary . The operator is taken to be the negative Laplacian plus a scattering term:
(7) |
where is our unknown potential, not necessarily small, but with compact support. The initial data is assumed to be localized at source , and the corresponding exact forward solutions to (4-5) are
(8) |
where the square root and cosine are defined via the spectral theorem. These solutions are assumed to be unknown, except near the receiver. The data here is monostatic, that is, we measure the data from source only back at the receiver collocated with the source. The data is measured at the evenly spaced time steps for and is modeled by
(9) | |||||
The inverse problem is as follows: Given
reconstruct . We will also need to assume we have background fields , solutions to (4-5) corresponding to . Denote the full background transfer function by and background solution anti-derivatives by
Note that satisfy (4) for with homogeneous Neumann boundary conditions and Neumann initial conditions
(10) | |||||
(11) |
Throughout the process we will use the following form of the Lippmann-Schwinger equation
(12) |
We remind the reader that the inverse Born method is to replace the unknown field in (12) with the corresponding background solution , and solve for . The LSL method is to instead use the ROM-based data generated internal fields, which we denote . As one would expect, these data generated fields would be much more accurate were we to have the full MIMO data for instead of the SISO only data . This is precisely the motivation for this work. We propose the following algorithm:
Algorithm 1 (Data completion for ROM-based internal solutions)
Given monostatic data for for sources :
-
1.
SISO step: Use LSL for true SISO data to generate approximate and internal fields .
-
2.
Lifting step: given approximate and internal solutions , compute for all inaccessible pairs
-
3.
MIMO step: given a full and its mass matrix , compute new internal fields and new approximate from Lippmann-Schwinger.
-
4.
Exit or return to lifting step 2.
3 Step 1: The LSL algorithm for SISO data
This step is precisely to perform the algorithm from [17]. We include a short description here, see [17] and also [15],[16] for more details. We assume we are given only the diagonal response
(13) |
for , . For each source, we will compute a mass matrix and corresponding approximate internal snapshots. Let be the true internal fields corresponding to source , and consider the snapshots
for . The mass matrix corresponding to this source is defined by
(14) |
for . Given the expression (8) for the exact solution, we have that,
(15) |
The steps are as follows.
- 1.
-
2.
Orthogonalize the snapshots: Compute the Cholesky decompositions (note each is positive definite),
where each is upper triangular, for . This allows us to define the sequentially orthogonalized snapshots
(17) where is the column vector of the true (still unknown) snapshots.
-
3.
Repeat for the background medium: Compute the background snapshots , the mass matrices
(18) their Cholesky decompositions
and the orthogonalized background snapshots,
(19) -
4.
Compute data generated internal snapshots: In this step we replace the unknown orthogonalized snapshots with the orthogonalized background snapshots . They should be close in the sense of spherical averages; see [17] Section 4.2 for a discussion and Figure 7.7 in Section 7 here for a numerical example comparing internal solutions. From (17) and (19), we have our approximations to the internal snapshots:
-
5.
Invert the Lippmann-Schwinger equation: In order to obtain an estimate for the unknown , we now use the Lippmann-Schwinger equation. For each time step , , and for each source , we have that
(21) The Lippmann-Schwinger-Lanczos method is to replace in the above by its data generated approximation from (4). Let be a time interpolant of , and we solve
(22) for , , yielding equations to be inverted to find , an approximation to .
4 Step 2: Data completion and its mass matrix
In this step we assume we are given an approximation to the internal snapshots for , , along with an approximation to the unknown . We now use (12) to approximate the off diagonals of .
-
1.
Data lifting: For , compute approximations to
(23) Define the diagonals
(24) by the actual data values. What we have now is the lifted data
Note that the number of time steps is reduced by half compared to the original data (or the data from the previous lifting iterate).
- 2.
-
3.
Regularization of : Since is not a true mass matrix, it will likely not be symmetric positive definite, so regularization is required. We regularize by taking the symmetric part and thresholding: all eigenvalues below a chosen small are set to . We note the result here is not very sensitive to the choice of , provided that is smaller than the minimum positive eigenvalue of . In our experiments we pick where is the maximum positive eigenvalue of . We note that this corresponds to the geometric mean of and the minimum value for stable linear algebraic operations with modified in machine double precision. We abuse notation and continue to denote this regularized mass matrix by .
5 Step 3: The MIMO LSL algorithm for completed data
In this step we assume we have a positive definite mass matrix computed from a full , where is corresponding to time steps . The first time that we perform this step we will have ; subsequent steps will be halved in size.
-
1.
Orthogonalize the snapshots: We do a block Cholesky (with blocks) decomposition,
where is block upper triangular. We note that there is some ambiguity in the choice of the blocks; we choose them so that all resulting orthogonalized functions
are all mutually orthogonal.
-
2.
Repeat for the background medium: Compute the background MIMO mass matrix corresponding to the same time steps, its Cholesky decomposition
and the orthogonalized background snapshots
-
3.
Compute new data generated internal snapshots:
An important point is that these internal fields have been improved substantially compared to those generated in Step 1.
-
4.
Invert the Lippman-Schwinger equation: Let be a time interpolant of the fields in corresponding to the th source, and solve the Lippmann-Schwinger equation
(26) to obtain a new approximation to the unknown . In this Lippmann-Schwinger step we use only the true SISO data, since our lifted off diagonals do not add any new information; they were used only to improve the internal fields.
6 Step 4: loop for iterations
We note that our experiments suggest that whether or not we need to proceed with iterations and return to step 2 depends on the number of targets to resolve. Our observations show that the number of iterations should be one less than the maximum number of objects with internal multiples. In particular, for the problems with two targets we will consider section 7, no loop is needed. However, there is benefit from having an extra iteration for the three-objects problem (see our last numerical example). We can vaguely explain this as follows: the Born solution (as well as LSL without completion) successfully resolve the closest target only, while the images of deeper ones are polluted by multiple echoes. Then, every iteration of LSL with completion cleans up these multiples from the deeper and deeper objects one by one. In this sense there is a similarity between our approach and the Inverse Born Series [24], however, a more precise connection needs to be explored further.
7 Numerical Experiments
![Refer to caption](extracted/5701246/figs/true_2obj.png)
![Refer to caption](extracted/5701246/figs/intsol_2obj_t=15.png)
True | Born |
![]() |
![]() |
LSL w/o completion | LSL with completion |
![]() |
![]() |
2nd iteration of data completion fo LSL |
![]() |
True | Born |
![]() |
![]() |
LSL w/o completion | LSL with completion |
![]() |
![]() |
LSL with completion for noisy data |
![]() |
True | Born |
![]() |
![]() |
LSL w/o completion | LSL with completion |
![]() |
![]() |
In our first numerical experiment, we considered the imaging of two elongated targets in a homogeneous background (see Fig. 1). To obtain synthetic data, we discretized 4 in using finite-differences on a 2D grid. The obtained discrete problem was solved for 27 positions of radar that were emitting a non-modulated Gaussian pulse (radar positions are marked by crosses in Fig. 1). To solve the Lippmann-Schwinger equation, we discretized it using quadrature on a grid. First, we examine how data completion improves the accuracy of the internal fields. In Fig. 2 we see the true internal solution (top left) and the background solution (top middle), which is used for the Born approximation in (12). The ROM-based SISO internal solution without data completion is shown in the top right. While the background solution doesn’t have any reflections, the internal solution we obtained without data completion captures the reflections in the sense of spherical averages. The internal solution computed after data completion is shown in the bottom left. As one can observe, MIMO data completion improves the accuracy of the internal solution reconstruction significantly. We also note that the second iteration made the profile sharper (see bottom right), however, all of the multiples were already captured during the first iteration.
In Figure 3 we compare reconstructions for this first example, where we see the Born image (top right) and LSL images without and with data completion (middle left and right respectively). We note that the ROM step had to be performed in a structure-preserving way in order to obtain a stable internal solution. The data completion for this first example results in a significantly sharper image of two targets, with almost no ghost reflections. As was expected, the second iteration (bottom plot) didn’t yield any improvement for this two target model. We note that in each of the reconstructions we chose the SVD truncation level which was best for each separately, which is why the frequency of the artifacts appears higher for the LSL with completion. In all cases the artifacts seen in these pictures could possibly be further diminished by using sparse or other regularization techniques.
For our second example we considered another two dimensional target (see top left plot in Figure 4) with 60 sources and receivers located at the top and emitting a non-modulated Gaussian pulse. We used an finite-difference grid for discretization of the forward problem in to generate synthetic data. Then, data-driven internal solutions were obtained and we solved the Lippmann–Schwinger equation using the quadrature on a grid. Similar to the previous example, the data completion (middle right) really sharpens the image compared to Born (top right) and LSL without completion (middle left), and in this case allows us to resolve the image inside of the box. In this experiment we added the result with 5% relative random noise (see bottom plot) to show a low sensitivity of the approach to the measurement errors.
For our next example, we considered a 2.5D problem, where our waves are fully three dimensional but the medium is assumed to be homogeneous in the transversal direction (see top left in Fig. 5). The forward problem was discretized on a grid in a 3D domain . Similar to the first example, we used 27 sources/receivers with a non-modulated Gaussian pulse and solved the discrete problems for them to obtain synthetic data. We then computed the ROM-based approximants of the internal solutions and plugged them in into the Lippmann-Schwinger equation, which was then solved for a 2D image via quadratures on a grid. We see the reconstructions in Figure 5. Born (top right) and LSL without completion (bottom left) both show significant ghost reflections, but these are greatly reduced with one step of LSL with data completion (bottom right).
For all of the examples above, adding an extra iteration of data completion in LSL will not improve the image. Indeed, as we noted before, iterations for LSL with data completion are beneficial when there are more than two objects that produce internal multiples. To illustrate this, we considered the 2D problem with 3 objects shown in Fig. 6. Our modeling and inversion setups were precisely the same as in the second example, i.e. an grid in , non-modulated Gaussian pulses emitted by 60 sources/receivers and quadrature for the Lippmann-Schwinger equation on a grid. In Fig. 7 we show how the extra iteration (bottom right) of LSL with data completion improved the internal solution (bottom left), though both are significantly closer to the exact solution (top left) than Born (top middle) and LSL without completion (top right). This improved internal solution helped to reveal the deepest object in the model (see bottom right plot in Fig.8), which was neither visible in the Born image (top left), nor in the LSL images without completion (top right) and with one iteration of completion (bottom left).
![Refer to caption](extracted/5701246/figs/true_3obj.png)
![Refer to caption](extracted/5701246/figs/intsol_3obj_t=35.png)
Born | LSL w/o completion |
![]() |
![]() |
1 iteration of LSL with completion | 2 iterations of LSL with completion |
![]() |
![]() |
8 Conclusions
In the ROM based Lippmann-Schwinger-Lanczos method, one constructs data driven internal solutions, and uses them in the Lippmann-Schwinger integral. When the given data is monostatic, as is the case for SAR, these internal solutions are only accurate up to spherical averages. We saw here that adding the step of ROM based data completion can dramatically improve the accuracy of the internal solutions, leading to sharpened reconstructions. Moreover, additional iterations of data completion in LSL can improve images further in the case of complex models with more than two objects producing internal multiples.
Many practically important problems have more complicated data matrix patterns than shown in (1-2). For example, in the case of tomographic ultrasound, the data acquisition may be block diagonal. The method we described in this work can be extended many of those cases as well [25]. The LSL approach can also be extended in some cases to variable wave speed problems, in particular for small slow speed perturbations [1], or more generally by combining with iteration [8]. We plan to investigate extension of this data-completion approach to these and more general setups in future work.
Acknowledgments The authors are grateful to Liliana Borcea, Alex Mamonov and Jörn Zimmerling for productive discussions that inspired this research. V. Druskin was partially supported by AFOSR grants FA 955020-1-0079, FA9550-20-1-0079, and NSF grant DMS-2110773. M. Zaslavsky was partially supported by AFOSR grant FA9550-20-1-0079. S. Moskow was partially supported by NSF grants DMS-2008441 and DMS-2308200.
References
- [1] J. Baker, E. Cherkaev, V. Druskin, S. Moskow, and M. Zaslavsky. Doubly regularized lippmann-schwinger-lanczos algorithm for inverse scattering problems in the frequency domain. submitted.
- [2] L. Borcea, V. Druskin, A. Mamonov, M. Zaslavsky, and J. Zimmerling. Reduced order model approach to inverse scattering. SIAM Journal on Imaging Sciences, 13(2):685–723, 2020.
- [3] Liliana Borcea, Vladimir Druskin, Fernando Guevara Vasquez, and Alexander V. Mamonov. Resistor network approaches to electrical impedance tomography. Inverse Problems and Applications: Inside Out II, Math. Sci. Res. Inst. Publ, 60:55–118, 2011.
- [4] Liliana Borcea, Vladimir Druskin, Alexander V. Mamonov, Shari Moskow, and Mikhail Zaslavsky. Reduced order models for spectral domain inversion: embedding into the continuous problem and generation of internal data. Inverse Problems, 36(5), 2020.
- [5] Liliana Borcea, Vladimir Druskin, Alexander V. Mamonov, and Mikhail Zaslavsky. A model reduction approach to numerical inversion for a parabolic partial differential equation. Inverse Problems, 30(12):125011, 2014.
- [6] Liliana Borcea, Vladimir Druskin, Alexander V Mamonov, and Mikhail Zaslavsky. Untangling nonlinearity in inverse scattering with data-driven reduced order models. Inverse Problems, 34(6):065008, 2018.
- [7] Liliana Borcea, Vladimir Druskin, Alexander V. Mamonov, and Mikhail Zaslavsky. Robust nonlinear processing of active array data in inverse scattering via truncated reduced order models. Journal of Computational Physics, 381:1–26, 2019.
- [8] Liliana Borcea, Josselin Garnier, Alexander V. Mamonov, and Jörn Zimmerling. Waveform inversion with a data driven estimate of the internal wave. SIAM Journal on Imaging Sciences, 16(1):280–312, 2023.
- [9] Liliana Borcea, Josselin Garnier, Alexander V. Mamonov, and Jörn T. Zimmerling. Reduced order model approach for imaging with waves. ArXiv, abs/2108.01609, 2021.
- [10] Matthew J. Burfeindt and Hatim F. Alqadah. Phase-encoded linear sampling method imaging of 3d targets from circular synthetic aperture data. In 2024 IEEE Radar Conference (RadarConf24), pages 1–6, 2024.
- [11] Fioralba Cakoni, David Colton, and Peter Monk. The Linear Sampling Method in Inverse Electromagnetic Scattering. Society for Industrial and Applied Mathematics, 2011.
- [12] Margaret Cheney, Matthew J Burfeindt, and NAVAL RESEARCH LAB WASHINGTON DCColorado State University. A procedure for suppressing multiple scattering. 2021.
- [13] V. Druskin, A.V. Mamonov, and M. Zaslavsky. A nonlinear method for imaging with acoustic waves via reduced order model backprojection. SIAM Journal on Imaging Sciences, 11(1):164–196, 2018.
- [14] Vladimir Druskin, Alexander V. Mamonov, Andrew E. Thaler, and Mikhail Zaslavsky. Direct, nonlinear inversion algorithm for hyperbolic problems via projection-based model reduction. SIAM Journal on Imaging Sciences, 9(2):684–747, 2016.
- [15] Vladimir Druskin, Shari Moskow, and Mikhail Zaslavsky. Lippmann-schwinger-lanczos algorithm for inverse scattering problems. Inverse Problems, apr 2021.
- [16] Vladimir Druskin, Shari Moskow, and Mikhail Zaslavsky. On extension of the data driven rom inverse scattering framework to partially nonreciprocal arrays. Inverse Problems, 8(38), 2022.
- [17] Vladimir Druskin, Shari Moskow, and Mikhail Zaslavsky. Reduced order modeling inversion of monostatic data in a multi-scattering environment. SIAM Journal on Imaging Sciences, 17(1), 2024.
- [18] Mikhail Gilman and Semyon Tsynkov. A mathematical model for sar imaging beyond the first born approximation. SIAM Journal on Imaging Sciences, 8(1):186–225, 2015.
- [19] Paul Kepley, Lauri Oksanen, and Maarten V. de Hoop. Generating virtual interior point source traveltimes and redatuming using boundary control. Seg Technical Program Expanded Abstracts, 2016.
- [20] Jerry T. Kim, Eric L. Mokole, and Margaret Cheney. Concept of iterative time-reversal radar (itrr). In 2023 IEEE Conference on Antenna Measurements and Applications (CAMA), pages 411–416, 2023.
- [21] Michael V. Klibanov, Alexey V. Smirnov, Vo A. Khoa, Anders J. Sullivan, and Lam H. Nguyen. Through-the-wall nonlinear sar imaging. IEEE Transactions on Geoscience and Remote Sensing, 59(9):7475–7486, 2021.
- [22] John Lagergren, Kevin Flores, Mikhail Gilman, and Semyon Tsynkov. Deep learning approach to the detection of scattering delay in radar images. Journal of Statistical Theory and Practice, 15(1):14, 2021.
- [23] Alison E. Malcolm, Maarten V. de Hoop, and Henri Calandra. Identification of image artifacts from internal multiples. Geophysics, 72, 2007.
- [24] Shari Moskow and John C. Schotland. 12. Inverse Born series. The Radon Transform: The First 100 Years and Beyond, edited by Ronny Ramlau and Otmar Scherzer, pages 273–296. De Gruyter, Berlin, Boston, 2019.
- [25] J. D. Roberts. Linear model reduction and solution of the algebraic Riccati equation by use of the sign function. Internat. J. Control, 32(4):677–687, 1980. First issued as report CUED/B-Control/TR13, Department of Engineering, University of Cambridge, 1971.
- [26] Jean Virieux. An introduction to full waveform inversion. 2016.
- [27] Francis Watson, Daniel Andre, and William R B Lionheart. Resolving full-wave through-wall transmission effects in multi-static synthetic aperture radar. Inverse Problems, 2024.