Showing 1–50 of 74 results for author: Herrmann, F

Apparent phase transitions and critical-like behavior in multi-component mixtures

Authors: Felix Herrmann, Burkhard Dünweg, Martin Girard

Abstract: Liquid-liquid phase separation has recently emerged as an important topic in the context of cellular organization. Within this context, there are multiple poorly understood features; for instance hints of critical behavior in the plasma membrane, and how homeostasis maintains phase separation. In this paper, using statistical mechanics, we show that finite size effects in multicomponent mixtures c… ▽ More Liquid-liquid phase separation has recently emerged as an important topic in the context of cellular organization. Within this context, there are multiple poorly understood features; for instance hints of critical behavior in the plasma membrane, and how homeostasis maintains phase separation. In this paper, using statistical mechanics, we show that finite size effects in multicomponent mixtures can induce the system to behave as-if it were near a critical point, which we term apparent transitions. The apparent transition temperature is naturally driven towards the ambient temperature of the system. △ Less

Submitted 24 June, 2024; originally announced June 2024.

Generative Geostatistical Modeling from Incomplete Well and Imaged Seismic Observations with Diffusion Models

Authors: Huseyin Tuna Erdinc, Rafael Orozco, Felix J. Herrmann

Abstract: In this study, we introduce a novel approach to synthesizing subsurface velocity models using diffusion generative models. Conventional methods rely on extensive, high-quality datasets, which are often inaccessible in subsurface applications. Our method leverages incomplete well and seismic observations to produce high-fidelity velocity samples without requiring fully sampled training datasets. Th… ▽ More In this study, we introduce a novel approach to synthesizing subsurface velocity models using diffusion generative models. Conventional methods rely on extensive, high-quality datasets, which are often inaccessible in subsurface applications. Our method leverages incomplete well and seismic observations to produce high-fidelity velocity samples without requiring fully sampled training datasets. The results demonstrate that our generative model accurately captures long-range structures, aligns with ground-truth velocity models, achieves high Structural Similarity Index (SSIM) scores, and provides meaningful uncertainty estimations. This approach facilitates realistic subsurface velocity synthesis, offering valuable inputs for full-waveform inversion and enhancing seismic-based subsurface modeling. △ Less

Submitted 16 May, 2024; originally announced June 2024.

WISER: multimodal variational inference for full-waveform inversion without dimensionality reduction

Authors: Ziyi Yin, Rafael Orozco, Felix J. Herrmann

Abstract: We present a semi-amortized variational inference framework designed for computationally feasible uncertainty quantification in 2D full-waveform inversion to explore the multimodal posterior distribution without dimensionality reduction. The framework is called WISER, short for full-Waveform variational Inference via Subsurface Extensions with Refinements. WISER leverages the power of generative a… ▽ More We present a semi-amortized variational inference framework designed for computationally feasible uncertainty quantification in 2D full-waveform inversion to explore the multimodal posterior distribution without dimensionality reduction. The framework is called WISER, short for full-Waveform variational Inference via Subsurface Extensions with Refinements. WISER leverages the power of generative artificial intelligence to perform approximate amortized inference that is low-cost albeit showing an amortization gap. This gap is closed through non-amortized refinements that make frugal use of acoustic wave physics. Case studies illustrate that WISER is capable of full-resolution, computationally feasible, and reliable uncertainty estimates of velocity models and imaged reflectivities. △ Less

Submitted 24 June, 2024; v1 submitted 3 May, 2024; originally announced May 2024.

A Digital Twin for Geological Carbon Storage with Controlled Injectivity

Authors: Abhinav Prakash Gahlot, Haoyun Li, Ziyi Yin, Rafael Orozco, Felix J. Herrmann

Abstract: We present an uncertainty-aware Digital Twin (DT) for geologic carbon storage (GCS), capable of handling multimodal time-lapse data and controlling CO2 injectivity to mitigate reservoir fracturing risks. In GCS, DT represents virtual replicas of subsurface systems that incorporate real-time data and advanced generative Artificial Intelligence (genAI) techniques, including neural posterior density… ▽ More We present an uncertainty-aware Digital Twin (DT) for geologic carbon storage (GCS), capable of handling multimodal time-lapse data and controlling CO2 injectivity to mitigate reservoir fracturing risks. In GCS, DT represents virtual replicas of subsurface systems that incorporate real-time data and advanced generative Artificial Intelligence (genAI) techniques, including neural posterior density estimation via simulation-based inference and sequential Bayesian inference. These methods enable the effective monitoring and control of CO2 storage projects, addressing challenges such as subsurface complexity, operational optimization, and risk mitigation. By integrating diverse monitoring data, e.g., geophysical well observations and imaged seismic, DT can bridge the gaps between seemingly distinct fields like geophysics and reservoir engineering. In addition, the recent advancements in genAI also facilitate DT with principled uncertainty quantification. Through recursive training and inference, DT utilizes simulated current state samples, e.g., CO2 saturation, paired with corresponding geophysical field observations to train its neural networks and enable posterior sampling upon receiving new field data. However, it lacks decision-making and control capabilities, which is necessary for full DT functionality. This study aims to demonstrate how DT can inform decision-making processes to prevent risks such as cap rock fracturing during CO2 storage operations. △ Less

Submitted 28 March, 2024; originally announced March 2024.

Time-lapse full-waveform permeability inversion: a feasibility study

Authors: Ziyi Yin, Mathias Louboutin, Olav Møyner, Felix J. Herrmann

Abstract: Time-lapse seismic monitoring necessitates integrated workflows that combine seismic and reservoir modeling to enhance reservoir property estimation. We present a feasibility study of an end-to-end inversion framework that directly inverts for permeability from prestack time-lapse seismic data. To assess the method's robustness, we design experiments focusing on its sensitivity to initial models a… ▽ More Time-lapse seismic monitoring necessitates integrated workflows that combine seismic and reservoir modeling to enhance reservoir property estimation. We present a feasibility study of an end-to-end inversion framework that directly inverts for permeability from prestack time-lapse seismic data. To assess the method's robustness, we design experiments focusing on its sensitivity to initial models and potential errors in modeling. Our study leverages the Compass model to simulate CO2 storage in saline aquifers, which is derived from well and seismic data from the North Sea, a candidate site for geological carbon storage. △ Less

Submitted 6 March, 2024; originally announced March 2024.

Quantum Electrometer for Time-Resolved Material Science at the Atomic Lattice Scale

Authors: Gregor Pieplow, Cem Güney Torun, Joseph H. D. Munns, Franziska Marie Herrmann, Andreas Thies, Tommaso Pregnolato, Tim Schröder

Abstract: The detection of individual charges plays a crucial role in fundamental material science and the advancement of classical and quantum high-performance technologies that operate with low noise. However, resolving charges at the lattice scale in a time-resolved manner has not been achieved so far. Here, we present the development of an electrometer, leveraging on the spectroscopy of an optically-act… ▽ More The detection of individual charges plays a crucial role in fundamental material science and the advancement of classical and quantum high-performance technologies that operate with low noise. However, resolving charges at the lattice scale in a time-resolved manner has not been achieved so far. Here, we present the development of an electrometer, leveraging on the spectroscopy of an optically-active spin defect embedded in a solid-state material with a non-linear Stark response. By applying our approach to diamond, a widely used platform for quantum technology applications, we successfully localize charge traps, quantify their impact on transport dynamics and noise generation, analyze relevant material properties, and develop strategies for material optimization. △ Less

Submitted 25 January, 2024; originally announced January 2024.

Comments: Main: 9 pages, 5 figures; Supplement: 14 pages, 10 figures

WISE: full-Waveform variational Inference via Subsurface Extensions

Authors: Ziyi Yin, Rafael Orozco, Mathias Louboutin, Felix J. Herrmann

Abstract: We introduce a probabilistic technique for full-waveform inversion, employing variational inference and conditional normalizing flows to quantify uncertainty in migration-velocity models and its impact on imaging. Our approach integrates generative artificial intelligence with physics-informed common-image gathers, reducing reliance on accurate initial velocity models. Considered case studies demo… ▽ More We introduce a probabilistic technique for full-waveform inversion, employing variational inference and conditional normalizing flows to quantify uncertainty in migration-velocity models and its impact on imaging. Our approach integrates generative artificial intelligence with physics-informed common-image gathers, reducing reliance on accurate initial velocity models. Considered case studies demonstrate its efficacy producing realizations of migration-velocity models conditioned by the data. These models are used to quantify amplitude and positioning effects during subsequent imaging. △ Less

Submitted 10 December, 2023; originally announced January 2024.

Optical probing of phononic properties of a tin-vacancy color center in diamond

Authors: Cem Güney Torun, Joseph H. D. Munns, Franziska Marie Herrmann, Viviana Villafane, Kai Müller, Andreas Thies, Tommaso Pregnolato, Gregor Pieplow, Tim Schröder

Abstract: The coherence characteristics of a tin-vacancy color center in diamond are investigated through optical means including coherent population trap** between the ground state orbital levels and linewidth broadening effects. Due to the large spin-orbit splitting of the orbital ground states, thermalization between the ground states occurs at rates that are impractical to measure directly. Here, spec… ▽ More The coherence characteristics of a tin-vacancy color center in diamond are investigated through optical means including coherent population trap** between the ground state orbital levels and linewidth broadening effects. Due to the large spin-orbit splitting of the orbital ground states, thermalization between the ground states occurs at rates that are impractical to measure directly. Here, spectral information is transformed into its conjugate variable time, providing picosecond resolution and revealing an orbital depolarization timescale of ${\sim30{\rm~ps}}$. Consequences of the investigated dynamics are then used to estimate spin dephasing times limited by thermal effects. △ Less

Submitted 8 December, 2023; originally announced December 2023.

Comments: 17 pages, 14 figures, 1 table

3D seismic survey design by maximizing the spectral gap

Authors: Yijun Zhang, Ziyi Yin, Oscar López, Ali Siahkoohi, Mathias Louboutin, Felix J. Herrmann

Abstract: The massive cost of 3D acquisition calls for methods to reduce the number of receivers by designing optimal receiver sampling masks. Recent studies on 2D seismic showed that maximizing the spectral gap of the subsampling mask leads to better wavefield reconstruction results. We enrich the current study by proposing a simulation-free method to generate optimal 3D acquisition by maximizing the spect… ▽ More The massive cost of 3D acquisition calls for methods to reduce the number of receivers by designing optimal receiver sampling masks. Recent studies on 2D seismic showed that maximizing the spectral gap of the subsampling mask leads to better wavefield reconstruction results. We enrich the current study by proposing a simulation-free method to generate optimal 3D acquisition by maximizing the spectral gap of the subsampling mask via a simulated annealing algorithm. Numerical experiments confirm improvement of the proposed method over receiver sampling locations obtained by jittered sampling. △ Less

Submitted 3 November, 2023; originally announced November 2023.

Inference of CO2 flow patterns -- a feasibility study

Authors: Abhinav Prakash Gahlot, Huseyin Tuna Erdinc, Rafael Orozco, Ziyi Yin, Felix J. Herrmann

Abstract: As the global deployment of carbon capture and sequestration (CCS) technology intensifies in the fight against climate change, it becomes increasingly imperative to establish robust monitoring and detection mechanisms for potential underground CO2 leakage, particularly through pre-existing or induced faults in the storage reservoir's seals. While techniques such as history matching and time-lapse… ▽ More As the global deployment of carbon capture and sequestration (CCS) technology intensifies in the fight against climate change, it becomes increasingly imperative to establish robust monitoring and detection mechanisms for potential underground CO2 leakage, particularly through pre-existing or induced faults in the storage reservoir's seals. While techniques such as history matching and time-lapse seismic monitoring of CO2 storage have been used successfully in tracking the evolution of CO2 plumes in the subsurface, these methods lack principled approaches to characterize uncertainties related to the CO2 plumes' behavior. Inclusion of systematic assessment of uncertainties is essential for risk mitigation for the following reasons: (i) CO2 plume-induced changes are small and seismic data is noisy; (ii) changes between regular and irregular (e.g., caused by leakage) flow patterns are small; and (iii) the reservoir properties that control the flow are strongly heterogeneous and typically only available as distributions. To arrive at a formulation capable of inferring flow patterns for regular and irregular flow from well and seismic data, the performance of conditional normalizing flow will be analyzed on a series of carefully designed numerical experiments. While the inferences presented are preliminary in the context of an early CO2 leakage detection system, the results do indicate that inferences with conditional normalizing flows can produce high-fidelity estimates for CO2 plumes with or without leakage. We are also confident that the inferred uncertainty is reasonable because it correlates well with the observed errors. This uncertainty stems from noise in the seismic data and from the lack of precise knowledge of the reservoir's fluid flow properties. △ Less

Submitted 28 November, 2023; v1 submitted 1 November, 2023; originally announced November 2023.

Comments: Accepted in NeurIPS 2023 Workshop - Tackling Climate Change with Machine Learning (Spotlight)

Arbitrary electro-optic bandwidth and frequency control in lithium niobate optical resonators

Authors: Jason F. Herrmann, Devin J. Dean, Christopher J. Sarabalis, Vahid Ansari, Kevin Multani, E. Alex Wollack, Timothy P. McKenna, Jeremy D. Witmer, Amir H. Safavi-Naeini

Abstract: In situ tunable photonic filters and memories are important for emerging quantum and classical optics technologies. However, most photonic devices have fixed resonances and bandwidths determined at the time of fabrication. Here we present an in situ tunable optical resonator on thin-film lithium niobate. By leveraging the linear electro-optic effect, we demonstrate widely tunable control over reso… ▽ More In situ tunable photonic filters and memories are important for emerging quantum and classical optics technologies. However, most photonic devices have fixed resonances and bandwidths determined at the time of fabrication. Here we present an in situ tunable optical resonator on thin-film lithium niobate. By leveraging the linear electro-optic effect, we demonstrate widely tunable control over resonator frequency and bandwidth on two different devices. We observe up to $\sim50\times$ tuning in the bandwidth over $\sim50$ V with linear frequency control of $\sim230$ MHz/V. We also develop a closed-form model predicting the tuning behavior of the device. This paves the way for rapid phase and amplitude control over light transmitted through our device. △ Less

Submitted 31 July, 2023; originally announced July 2023.

Comments: 22 pages, 11 figure, 2 tables

Solving multiphysics-based inverse problems with learned surrogates and constraints

Authors: Ziyi Yin, Rafael Orozco, Mathias Louboutin, Felix J. Herrmann

Abstract: Solving multiphysics-based inverse problems for geological carbon storage monitoring can be challenging when multimodal time-lapse data are expensive to collect and costly to simulate numerically. We overcome these challenges by combining computationally cheap learned surrogates with learned constraints. Not only does this combination lead to vastly improved inversions for the important fluid-flow… ▽ More Solving multiphysics-based inverse problems for geological carbon storage monitoring can be challenging when multimodal time-lapse data are expensive to collect and costly to simulate numerically. We overcome these challenges by combining computationally cheap learned surrogates with learned constraints. Not only does this combination lead to vastly improved inversions for the important fluid-flow property, permeability, it also provides a natural platform for inverting multimodal data including well measurements and active-source time-lapse seismic data. By adding a learned constraint, we arrive at a computationally feasible inversion approach that remains accurate. This is accomplished by including a trained deep neural network, known as a normalizing flow, which forces the model iterates to remain in-distribution, thereby safeguarding the accuracy of trained Fourier neural operators that act as surrogates for the computationally expensive multiphase flow simulations involving partial differential equation solves. By means of carefully selected experiments, centered around the problem of geological carbon storage, we demonstrate the efficacy of the proposed constrained optimization method on two different data modalities, namely time-lapse well and time-lapse seismic data. While permeability inversions from both these two modalities have their pluses and minuses, their joint inversion benefits from either, yielding valuable superior permeability inversions and CO2 plume predictions near, and far away, from the monitoring wells. △ Less

Submitted 14 September, 2023; v1 submitted 17 July, 2023; originally announced July 2023.

Efficient Photonic Integration of Diamond Color Centers and Thin-Film Lithium Niobate

Authors: Daniel Riedel, Hope Lee, Jason F. Herrmann, Jakob Grzesik, Vahid Ansari, Jean-Michel Borit, Hubert S. Stokowski, Shahriar Aghaeimeibodi, Haiyu Lu, Patrick J. McQuade, Nick A. Melosh, Zhi-Xun Shen, Amir H. Safavi-Naeini, Jelena Vučković

Abstract: On-chip photonic quantum circuits with integrated quantum memories have the potential to radically progress hardware for quantum information processing. In particular, negatively charged group-IV color centers in diamond are promising candidates for quantum memories, as they combine long storage times with excellent optical emission properties and an optically-addressable spin state. However, as a… ▽ More On-chip photonic quantum circuits with integrated quantum memories have the potential to radically progress hardware for quantum information processing. In particular, negatively charged group-IV color centers in diamond are promising candidates for quantum memories, as they combine long storage times with excellent optical emission properties and an optically-addressable spin state. However, as a material, diamond lacks many functionalities needed to realize scalable quantum systems. Thin-film lithium niobate (TFLN), in contrast, offers a number of useful photonic nonlinearities, including the electro-optic effect, piezoelectricity, and capabilities for periodically-poled quasi-phase matching. Here, we present highly efficient heterogeneous integration of diamond nanobeams containing negatively charged silicon-vacancy (SiV) centers with TFLN waveguides. We observe greater than 90\% transmission efficiency between the diamond nanobeam and TFLN waveguide on average across multiple measurements. By comparing saturation signal levels between confocal and integrated collection, we determine a $10$-fold increase in photon counts channeled into TFLN waveguides versus that into out-of-plane collection channels. Our results constitute a key step for creating scalable integrated quantum photonic circuits that leverage the advantages of both diamond and TFLN materials. △ Less

Submitted 27 June, 2023; originally announced June 2023.

Refining Amortized Posterior Approximations using Gradient-Based Summary Statistics

Authors: Rafael Orozco, Ali Siahkoohi, Mathias Louboutin, Felix J. Herrmann

Abstract: We present an iterative framework to improve the amortized approximations of posterior distributions in the context of Bayesian inverse problems, which is inspired by loop-unrolled gradient descent methods and is theoretically grounded in maximally informative summary statistics. Amortized variational inference is restricted by the expressive power of the chosen variational distribution and the av… ▽ More We present an iterative framework to improve the amortized approximations of posterior distributions in the context of Bayesian inverse problems, which is inspired by loop-unrolled gradient descent methods and is theoretically grounded in maximally informative summary statistics. Amortized variational inference is restricted by the expressive power of the chosen variational distribution and the availability of training data in the form of joint data and parameter samples, which often lead to approximation errors such as the amortization gap. To address this issue, we propose an iterative framework that refines the current amortized posterior approximation at each step. Our approach involves alternating between two steps: (1) constructing a training dataset consisting of pairs of summarized data residuals and parameters, where the summarized data residual is generated using a gradient-based summary statistic, and (2) training a conditional generative model -- a normalizing flow in our examples -- on this dataset to obtain a probabilistic update of the unknown parameter. This procedure leads to iterative refinement of the amortized posterior approximations without the need for extra training data. We validate our method in a controlled setting by applying it to a stylized problem, and observe improved posterior approximations with each iteration. Additionally, we showcase the capability of our method in tackling realistically sized problems by applying it to transcranial ultrasound, a high-dimensional, nonlinear inverse problem governed by wave physics, and observe enhanced posterior quality through better image reconstruction with the posterior mean. △ Less

Submitted 15 May, 2023; originally announced May 2023.

Learned multiphysics inversion with differentiable programming and machine learning

Authors: Mathias Louboutin, Ziyi Yin, Rafael Orozco, Thomas J. Grady II, Ali Siahkoohi, Gabrio Rizzuti, Philipp A. Witte, Olav Møyner, Gerard J. Gorman, Felix J. Herrmann

Abstract: We present the Seismic Laboratory for Imaging and Modeling/Monitoring (SLIM) open-source software framework for computational geophysics and, more generally, inverse problems involving the wave-equation (e.g., seismic and medical ultrasound), regularization with learned priors, and learned neural surrogates for multiphase flow simulations. By integrating multiple layers of abstraction, our softwar… ▽ More We present the Seismic Laboratory for Imaging and Modeling/Monitoring (SLIM) open-source software framework for computational geophysics and, more generally, inverse problems involving the wave-equation (e.g., seismic and medical ultrasound), regularization with learned priors, and learned neural surrogates for multiphase flow simulations. By integrating multiple layers of abstraction, our software is designed to be both readable and scalable. This allows researchers to easily formulate their problems in an abstract fashion while exploiting the latest developments in high-performance computing. We illustrate and demonstrate our design principles and their benefits by means of building a scalable prototype for permeability inversion from time-lapse crosswell seismic data, which aside from coupling of wave physics and multiphase flow, involves machine learning. △ Less

Submitted 11 April, 2023; originally announced April 2023.

Optimized time-lapse acquisition design via spectral gap ratio minimization

Authors: Yijun Zhang, Ziyi Yin, Oscar Lopez, Ali Siahkoohi, Mathias Louboutin, Rajiv Kumar, Felix J. Herrmann

Abstract: Modern-day reservoir management and monitoring of geological carbon storage increasingly call for costly time-lapse seismic data collection. In this letter, we show how techniques from graph theory can be used to optimize acquisition geometries for low-cost sparse 4D seismic. Based on midpoint-offset domain connectivity arguments, the proposed algorithm automatically produces sparse non-replicated… ▽ More Modern-day reservoir management and monitoring of geological carbon storage increasingly call for costly time-lapse seismic data collection. In this letter, we show how techniques from graph theory can be used to optimize acquisition geometries for low-cost sparse 4D seismic. Based on midpoint-offset domain connectivity arguments, the proposed algorithm automatically produces sparse non-replicated time-lapse acquisition geometries that favor wavefield recovery. △ Less

Submitted 2 February, 2023; originally announced February 2023.

De-risking Carbon Capture and Sequestration with Explainable CO2 Leakage Detection in Time-lapse Seismic Monitoring Images

Authors: Huseyin Tuna Erdinc, Abhinav Prakash Gahlot, Ziyi Yin, Mathias Louboutin, Felix J. Herrmann

Abstract: With the growing global deployment of carbon capture and sequestration technology to combat climate change, monitoring and detection of potential CO2 leakage through existing or storage induced faults are critical to the safe and long-term viability of the technology. Recent work on time-lapse seismic monitoring of CO2 storage has shown promising results in its ability to monitor the growth of the… ▽ More With the growing global deployment of carbon capture and sequestration technology to combat climate change, monitoring and detection of potential CO2 leakage through existing or storage induced faults are critical to the safe and long-term viability of the technology. Recent work on time-lapse seismic monitoring of CO2 storage has shown promising results in its ability to monitor the growth of the CO2 plume from surface recorded seismic data. However, due to the low sensitivity of seismic imaging to CO2 concentration, additional developments are required to efficiently interpret the seismic images for leakage. In this work, we introduce a binary classification of time-lapse seismic images to delineate CO2 plumes (leakage) using state-of-the-art deep learning models. Additionally, we localize the leakage region of CO2 plumes by leveraging Class Activation Map** methods. △ Less

Submitted 16 December, 2022; originally announced December 2022.

De-risking geological carbon storage from high resolution time-lapse seismic to explainable leakage detection

Authors: Ziyi Yin, Huseyin Tuna Erdinc, Abhinav Prakash Gahlot, Mathias Louboutin, Felix J. Herrmann

Abstract: Geological carbon storage represents one of the few truly scalable technologies capable of reducing the CO2 concentration in the atmosphere. While this technology has the potential to scale, its success hinges on our ability to mitigate its risks. An important aspect of risk mitigation concerns assurances that the injected CO2 remains within the storage complex. Amongst the different monitoring mo… ▽ More Geological carbon storage represents one of the few truly scalable technologies capable of reducing the CO2 concentration in the atmosphere. While this technology has the potential to scale, its success hinges on our ability to mitigate its risks. An important aspect of risk mitigation concerns assurances that the injected CO2 remains within the storage complex. Amongst the different monitoring modalities, seismic imaging stands out with its ability to attain high resolution and high fidelity images. However, these superior features come, unfortunately, at prohibitive costs and time-intensive efforts potentially rendering extensive seismic monitoring undesirable. To overcome this shortcoming, we present a methodology where time-lapse images are created by inverting non-replicated time-lapse monitoring data jointly. By no longer insisting on replication of the surveys to obtain high fidelity time-lapse images and differences, extreme costs and time-consuming labor are averted. To demonstrate our approach, hundreds of noisy time-lapse seismic datasets are simulated that contain imprints of regular CO2 plumes and irregular plumes that leak. These time-lapse datasets are subsequently inverted to produce time-lapse difference images used to train a deep neural classifier. The testing results show that the classifier is capable of detecting CO2 leakage automatically on unseen data and with a reasonable accuracy. △ Less

Submitted 7 October, 2022; originally announced November 2022.

Platform-agnostic waveguide integration of high-speed photodetectors with evaporated tellurium thin films

Authors: Geun Ho Ahn, Alexander D. White, Hyung** Kim, Naoki Higashitarumizu, Felix M. Mayor, Jason F. Herrmann, Wentao Jiang, Kevin K. S. Multani, Amir H. Safavi-Naeini, Ali Javey, Jelena Vučković

Abstract: Many attractive photonics platforms still lack integrated photodetectors due to inherent material incompatibilities and lack of process scalability, preventing their widespread deployment. Here we address the problem of scalably integrating photodetectors in a photonic platform-independent manner. Using a thermal evaporation and deposition technique developed for nanoelectronics, we show that tell… ▽ More Many attractive photonics platforms still lack integrated photodetectors due to inherent material incompatibilities and lack of process scalability, preventing their widespread deployment. Here we address the problem of scalably integrating photodetectors in a photonic platform-independent manner. Using a thermal evaporation and deposition technique developed for nanoelectronics, we show that tellurium (Te), a quasi-2D semi-conductive element, can be evaporated at low temperature directly onto photonic chips to form air-stable, high-responsivity, high-speed, ultrawide-band photodetectors. We demonstrate detection at visible, telecom, and mid-infrared wavelengths, a bandwidth of more than 40 GHz, and platform-independent scalable integration with photonic structures in silicon, silicon nitride and lithium niobate. △ Less

Submitted 8 September, 2022; originally announced September 2022.

Reliable amortized variational inference with physics-based latent distribution correction

Authors: Ali Siahkoohi, Gabrio Rizzuti, Rafael Orozco, Felix J. Herrmann

Abstract: Bayesian inference for high-dimensional inverse problems is computationally costly and requires selecting a suitable prior distribution. Amortized variational inference addresses these challenges via a neural network that approximates the posterior distribution not only for one instance of data, but a distribution of data pertaining to a specific inverse problem. During inference, the neural netwo… ▽ More Bayesian inference for high-dimensional inverse problems is computationally costly and requires selecting a suitable prior distribution. Amortized variational inference addresses these challenges via a neural network that approximates the posterior distribution not only for one instance of data, but a distribution of data pertaining to a specific inverse problem. During inference, the neural network -- in our case a conditional normalizing flow -- provides posterior samples at virtually no cost. However, the accuracy of amortized variational inference relies on the availability of high-fidelity training data, which seldom exists in geophysical inverse problems due to the Earth's heterogeneity. In addition, the network is prone to errors if evaluated over out-of-distribution data. As such, we propose to increase the resilience of amortized variational inference in the presence of moderate data distribution shifts. We achieve this via a correction to the latent distribution that improves the posterior distribution approximation for the data at hand. The correction involves relaxing the standard Gaussian assumption on the latent distribution and parameterizing it via a Gaussian distribution with an unknown mean and (diagonal) covariance. These unknowns are then estimated by minimizing the Kullback-Leibler divergence between the corrected and the (physics-based) true posterior distributions. While generic and applicable to other inverse problems, by means of a linearized seismic imaging example, we show that our correction step improves the robustness of amortized variational inference with respect to changes in the number of seismic sources, noise variance, and shifts in the prior distribution. This approach provides a seismic image with limited artifacts and an assessment of its uncertainty at approximately the same cost as five reverse-time migrations. △ Less

Submitted 18 January, 2023; v1 submitted 23 July, 2022; originally announced July 2022.

High-bandwidth CMOS-voltage-level electro-optic modulation of 780 nm light in thin-film lithium niobate

Authors: Oguz Tolga Celik, Christopher J. Sarabalis, Felix M. Mayor, Hubert S. Stokowski, Jason F. Herrmann, Timothy P. McKenna, Nathan R. A. Lee, Wentao Jiang, Kevin K. S. Multani, Amir H. Safavi-Naeini

Abstract: Integrated photonics operating at visible-near-infrared (VNIR) wavelengths offer scalable platforms for advancing optical systems for addressing atomic clocks, sensors, and quantum computers. The complexity of free-space control optics causes limited addressability of atoms and ions, and this remains an impediment on scalability and cost. Networks of Mach-Zehnder interferometers can overcome chall… ▽ More Integrated photonics operating at visible-near-infrared (VNIR) wavelengths offer scalable platforms for advancing optical systems for addressing atomic clocks, sensors, and quantum computers. The complexity of free-space control optics causes limited addressability of atoms and ions, and this remains an impediment on scalability and cost. Networks of Mach-Zehnder interferometers can overcome challenges in addressing atoms by providing high-bandwidth electro-optic control of multiple output beams. Here, we demonstrate a VNIR Mach-Zehnder interferometer on lithium niobate on sapphire with a CMOS voltage-level compatible full-swing voltage of 4.2 V and an electro-optic bandwidth of 2.7 GHz occupying only 0.35 mm$^2$. Our waveguides exhibit 1.6 dB/cm propagation loss and our microring resonators have intrinsic quality factors of 4.4 $\times$ 10$^5$. This specialized platform for VNIR integrated photonics can open new avenues for addressing large arrays of qubits with high precision and negligible cross-talk. △ Less

Submitted 6 April, 2022; originally announced April 2022.

Comments: 10 pages, 4 figures

A simulation-free seismic survey design by maximizing the spectral gap

Authors: Yijun Zhang, Mathias Louboutin, Ali Siahkoohi, Ziyi Yin, Rajiv Kumar, Felix J. Herrmann

Abstract: Due to the tremendous cost of seismic data acquisition, methods have been developed to reduce the amount of data acquired by designing optimal missing trace reconstruction algorithms. These technologies are designed to record as little data as possible in the field, while providing accurate wavefield reconstruction in the areas of the survey that are not recorded. This is achieved by designing ran… ▽ More Due to the tremendous cost of seismic data acquisition, methods have been developed to reduce the amount of data acquired by designing optimal missing trace reconstruction algorithms. These technologies are designed to record as little data as possible in the field, while providing accurate wavefield reconstruction in the areas of the survey that are not recorded. This is achieved by designing randomized subsampling masks that allow for accurate wavefield reconstruction via matrix completion methods. Motivated by these recent results, we propose a simulation-free seismic survey design that aims at improving the quality of a given randomized subsampling using a simulated annealing algorithm that iteratively increases the spectral gap of the subsampling mask, a property recently linked to the quality of the reconstruction. We demonstrate that our proposed method improves the data reconstruction quality for a fixed subsampling rate on a realistic synthetic dataset. △ Less

Submitted 5 April, 2022; originally announced April 2022.

Wave-equation-based inversion with amortized variational Bayesian inference

Authors: Ali Siahkoohi, Rafael Orozco, Gabrio Rizzuti, Felix J. Herrmann

Abstract: Solving inverse problems involving measurement noise and modeling errors requires regularization in order to avoid data overfit. Geophysical inverse problems, in which the Earth's highly heterogeneous structure is unknown, present a challenge in encoding prior knowledge through analytical expressions. Our main contribution is a generative-model-based regularization approach, robust to out-of-distr… ▽ More Solving inverse problems involving measurement noise and modeling errors requires regularization in order to avoid data overfit. Geophysical inverse problems, in which the Earth's highly heterogeneous structure is unknown, present a challenge in encoding prior knowledge through analytical expressions. Our main contribution is a generative-model-based regularization approach, robust to out-of-distribution data, which exploits the prior knowledge embedded in existing data and model pairs. Utilizing an amortized variational inference objective, a conditional normalizing flow (NF) is pretrained on pairs of low- and high-fidelity migrated images in order to achieve a low-fidelity approximation to the seismic imaging posterior distribution for previously unseen data. The NF is used after pretraining to reparameterize the unknown seismic image in an inversion scheme involving physics-guided data misfit and a Gaussian prior on the NF latent variable. Solving this optimization problem with respect to the latent variable enables us to leverage the benefits of data-driven conditional priors whilst being informed by physics and data. The numerical experiments demonstrate that the proposed inversion scheme produces seismic images with limited artifacts when dealing with noisy and out-of-distribution data. △ Less

Submitted 29 March, 2022; originally announced March 2022.

Accelerating innovation with software abstractions for scalable computational geophysics

Authors: Mathias Louboutin, Philipp A. Witte, Ali Siahkoohi, Gabrio Rizzuti, Ziyi Yin, Rafael Orozco, Felix J. Herrmann

Abstract: We present the SLIM (https://github.com/slimgroup) open-source software framework for computational geophysics, and more generally, inverse problems based on the wave-equation (e.g., medical ultrasound). We developed a software environment aimed at scalable research and development by designing multiple layers of abstractions. This environment allows the researchers to easily formulate their probl… ▽ More We present the SLIM (https://github.com/slimgroup) open-source software framework for computational geophysics, and more generally, inverse problems based on the wave-equation (e.g., medical ultrasound). We developed a software environment aimed at scalable research and development by designing multiple layers of abstractions. This environment allows the researchers to easily formulate their problem in an abstract fashion, while still being able to exploit the latest developments in high-performance computing. We illustrate and demonstrate the benefits of our software design on many geophysical applications, including seismic inversion and physics-informed machine learning for geophysics (e.g., loop unrolled imaging, uncertainty quantification), all while facilitating the integration of external software. △ Less

Submitted 28 March, 2022; originally announced March 2022.

Learned coupled inversion for carbon sequestration monitoring and forecasting with Fourier neural operators

Authors: Ziyi Yin, Ali Siahkoohi, Mathias Louboutin, Felix J. Herrmann

Abstract: Seismic monitoring of carbon storage sequestration is a challenging problem involving both fluid-flow physics and wave physics. Additionally, monitoring usually requires the solvers for these physics to be coupled and differentiable to effectively invert for the subsurface properties of interest. To drastically reduce the computational cost, we introduce a learned coupled inversion framework based… ▽ More Seismic monitoring of carbon storage sequestration is a challenging problem involving both fluid-flow physics and wave physics. Additionally, monitoring usually requires the solvers for these physics to be coupled and differentiable to effectively invert for the subsurface properties of interest. To drastically reduce the computational cost, we introduce a learned coupled inversion framework based on the wave modeling operator, rock property conversion and a proxy fluid-flow simulator. We show that we can accurately use a Fourier neural operator as a proxy for the fluid-flow simulator for a fraction of the computational cost. We demonstrate the efficacy of our proposed method by means of a synthetic experiment. Finally, our framework is extended to carbon sequestration forecasting, where we effectively use the surrogate Fourier neural operator to forecast the CO2 plume in the future at near-zero additional cost. △ Less

Submitted 27 March, 2022; originally announced March 2022.

Velocity continuation with Fourier neural operators for accelerated uncertainty quantification

Authors: Ali Siahkoohi, Mathias Louboutin, Felix J. Herrmann

Abstract: Seismic imaging is an ill-posed inverse problem that is challenged by noisy data and modeling inaccuracies -- due to errors in the background squared-slowness model. Uncertainty quantification is essential for determining how variability in the background models affects seismic imaging. Due to the costs associated with the forward Born modeling operator as well as the high dimensionality of seismi… ▽ More Seismic imaging is an ill-posed inverse problem that is challenged by noisy data and modeling inaccuracies -- due to errors in the background squared-slowness model. Uncertainty quantification is essential for determining how variability in the background models affects seismic imaging. Due to the costs associated with the forward Born modeling operator as well as the high dimensionality of seismic images, quantification of uncertainty is computationally expensive. As such, the main contribution of this work is a survey-specific Fourier neural operator surrogate to velocity continuation that maps seismic images associated with one background model to another virtually for free. While being trained with only 200 background and seismic image pairs, this surrogate is able to accurately predict seismic images associated with new background models, thus accelerating seismic imaging uncertainty quantification. We support our method with a realistic data example in which we quantify seismic imaging uncertainties using a Fourier neural operator surrogate, illustrating how variations in background models affect the position of reflectors in a seismic image. △ Less

Submitted 27 March, 2022; originally announced March 2022.

Enabling wave-based inversion on GPUs with randomized trace estimation

Authors: Mathias Louboutin, Felix J. Herrmann

Abstract: By building on recent advances in the use of randomized trace estimation to drastically reduce the memory footprint of adjoint-state methods, we present and validate an imaging approach that can be executed exclusively on accelerators. Results obtained on field-realistic synthetic datasets, which include salt and anisotropy, show that our method produces high-fidelity images. These findings open t… ▽ More By building on recent advances in the use of randomized trace estimation to drastically reduce the memory footprint of adjoint-state methods, we present and validate an imaging approach that can be executed exclusively on accelerators. Results obtained on field-realistic synthetic datasets, which include salt and anisotropy, show that our method produces high-fidelity images. These findings open the enticing perspective of 3D wave-based inversion technology with a memory footprint that matches the hardware and that runs exclusively on clusters of GPUs without the undesirable need to offload certain tasks to CPUs. △ Less

Submitted 11 March, 2022; v1 submitted 18 January, 2022; originally announced January 2022.

Deep Bayesian inference for seismic imaging with tasks

Authors: Ali Siahkoohi, Gabrio Rizzuti, Felix J. Herrmann

Abstract: We propose to use techniques from Bayesian inference and deep neural networks to translate uncertainty in seismic imaging to uncertainty in tasks performed on the image, such as horizon tracking. Seismic imaging is an ill-posed inverse problem because of bandwidth and aperture limitations, which is hampered by the presence of noise and linearization errors. Many regularization methods, such as tra… ▽ More We propose to use techniques from Bayesian inference and deep neural networks to translate uncertainty in seismic imaging to uncertainty in tasks performed on the image, such as horizon tracking. Seismic imaging is an ill-posed inverse problem because of bandwidth and aperture limitations, which is hampered by the presence of noise and linearization errors. Many regularization methods, such as transform-domain sparsity promotion, have been designed to deal with the adverse effects of these errors, however, these methods run the risk of biasing the solution and do not provide information on uncertainty in the image space and how this uncertainty impacts certain tasks on the image. A systematic approach is proposed to translate uncertainty due to noise in the data to confidence intervals of automatically tracked horizons in the image. The uncertainty is characterized by a convolutional neural network (CNN) and to assess these uncertainties, samples are drawn from the posterior distribution of the CNN weights, used to parameterize the image. Compared to traditional priors, it is argued in the literature that these CNNs introduce a flexible inductive bias that is a surprisingly good fit for a diverse set of problems. The method of stochastic gradient Langevin dynamics is employed to sample from the posterior distribution. This method is designed to handle large scale Bayesian inference problems with computationally expensive forward operators as in seismic imaging. Aside from offering a robust alternative to maximum a posteriori estimate that is prone to overfitting, access to these samples allow us to translate uncertainty in the image, due to noise in the data, to uncertainty on the tracked horizons. For instance, it admits estimates for the pointwise standard deviation on the image and for confidence intervals on its automatically tracked horizons. △ Less

Submitted 15 June, 2022; v1 submitted 10 October, 2021; originally announced October 2021.

Mirror symmetric on-chip frequency circulation of light

Authors: Jason F. Herrmann, Vahid Ansari, Jiahui Wang, Jeremy D. Witmer, Shanhui Fan, Amir H. Safavi-Naeini

Abstract: Integrated circulators and isolators are important for develo** on-chip optical technologies, such as laser cavities, communication systems, and quantum information processors. These devices appear to inherently require mirror symmetry breaking to separate backwards from forwards propagation, so existing implementations rely upon magnetic materials, or interactions driven by propagating waves. I… ▽ More Integrated circulators and isolators are important for develo** on-chip optical technologies, such as laser cavities, communication systems, and quantum information processors. These devices appear to inherently require mirror symmetry breaking to separate backwards from forwards propagation, so existing implementations rely upon magnetic materials, or interactions driven by propagating waves. In contrast to previous work, we demonstrate a mirror symmetric nonreciprocal device. Our device comprises three coupled photonic resonators implemented in thin-film lithium niobate. Applying radio frequency modulation, we drive conversion between the frequency eigenmodes of this system. We measure nearly 40 dB of isolation for approximately 75 mW of RF power near 1550 nm. We simultaneously generate nonreciprocal conversion between all of the eigenmodes in order to demonstrate circulation. Mirror symmetric circulation significantly simplifies the fabrication and operation of nonreciprocal integrated devices. Finally, we consider applications of such on-chip isolators and circulators, such as full-duplex isolation within a single waveguide. △ Less

Submitted 28 September, 2021; originally announced September 2021.

Comments: 7 pages, 4 figures (main body)

Photonic modal circulator using temporal refractive-index modulation with spatial inversion symmetry

Authors: Jiahui Wang, Jason F. Herrmann, Jeremy D. Witmer, Amir H. Safavi-Naeini, Shanhui Fan

Abstract: It has been demonstrated that dynamic refractive index modulation, which breaks time-reversal symmetry, can be used to create on-chip non-reciprocal photonic devices. In order to achieve amplitude non-reciprocity, all such devices moreover require modulations that break spatial symmetries, which adds complexity in implementations. Here we introduce a modal circulator, which achieves amplitude non-… ▽ More It has been demonstrated that dynamic refractive index modulation, which breaks time-reversal symmetry, can be used to create on-chip non-reciprocal photonic devices. In order to achieve amplitude non-reciprocity, all such devices moreover require modulations that break spatial symmetries, which adds complexity in implementations. Here we introduce a modal circulator, which achieves amplitude non-reciprocity through a circulation motion among three modes. We show that such a circulator can be achieved in a dynamically-modulated structure that preserves mirror symmetry, and as a result can be implemented using only a single standing-wave modulator, which significantly simplifies the implementation of dynamically-modulated non-reciprocal device. We also prove that in terms of the number of modes involved in the transport process, the modal circulator represents the minimum configuration in which complete amplitude non-reciprocity can be achieved while preserving spatial symmetry. △ Less

Submitted 10 May, 2021; originally announced May 2021.

Journal ref: Phys. Rev. Lett. 126(19) (2021) 193901

A practical workflow for land seismic wavefield recovery with weighted matrix factorization

Authors: Yijun Zhang, Felix J. Herrmann

Abstract: While wavefield reconstruction through weighted low-rank matrix factorizations has been shown to perform well on marine data, out-of-the-box application of this technology to land data is hampered by ground roll. The presence of these strong surface waves tends to dominate the reconstruction at the expense of the weaker body waves. Because ground roll is slow, it also suffers more from aliasing. T… ▽ More While wavefield reconstruction through weighted low-rank matrix factorizations has been shown to perform well on marine data, out-of-the-box application of this technology to land data is hampered by ground roll. The presence of these strong surface waves tends to dominate the reconstruction at the expense of the weaker body waves. Because ground roll is slow, it also suffers more from aliasing. To overcome these challenges, we introduce a practical workflow where the ground roll and body wave components are recovered separately and combined. We test the proposed approach blindly on a subset of the 3D SEAM Barrett dataset. With our technique, we recover densely sampled data from 25 percent randomly subsampled receivers. Independent comparisons on a single shot demonstrate significant improvements achievable with the presented workflow. △ Less

Submitted 16 April, 2021; originally announced April 2021.

Compressive time-lapse seismic monitoring of carbon storage and sequestration with the joint recovery model

Authors: Ziyi Yin, Mathias Louboutin, Felix J. Herrmann

Abstract: Time-lapse seismic monitoring of carbon storage and sequestration is often challenging because the time-lapse signature of the growth of CO2 plumes is weak in amplitude and therefore difficult to detect seismically. This situation is compounded by the fact that the surveys are often coarsely sampled and not replicated to reduce costs. As a result, images obtained for different vintages (baseline a… ▽ More Time-lapse seismic monitoring of carbon storage and sequestration is often challenging because the time-lapse signature of the growth of CO2 plumes is weak in amplitude and therefore difficult to detect seismically. This situation is compounded by the fact that the surveys are often coarsely sampled and not replicated to reduce costs. As a result, images obtained for different vintages (baseline and monitor surveys) often contain artifacts that may be attributed wrongly to time-lapse changes. To address these issues, we propose to invert the baseline and monitor surveys jointly. By using the joint recovery model, we exploit information shared between multiple time-lapse surveys. Contrary to other time-lapse methods, our approach does not rely on replicating the surveys to detect time-lapse changes. To illustrate this advantage, we present a numerical sensitivity study where CO2 is injected in a realistic synthetic model. This model is representative of the geology in the southeast of the North Sea, an area currently considered for carbon sequestration. Our example demonstrates that the joint recovery model improves the quality of time-lapse images allowing us to monitor the CO2 plume seismically. △ Less

Submitted 14 April, 2021; originally announced April 2021.

Comments: Submitted to Society of Exploration Geophysicists 2021 Annual Meeting

Learning by example: fast reliability-aware seismic imaging with normalizing flows

Authors: Ali Siahkoohi, Felix J. Herrmann

Abstract: Uncertainty quantification provides quantitative measures on the reliability of candidate solutions of ill-posed inverse problems. Due to their sequential nature, Monte Carlo sampling methods require large numbers of sampling steps for accurate Bayesian inference and are often computationally infeasible for large-scale inverse problems, such as seismic imaging. Our main contribution is a data-driv… ▽ More Uncertainty quantification provides quantitative measures on the reliability of candidate solutions of ill-posed inverse problems. Due to their sequential nature, Monte Carlo sampling methods require large numbers of sampling steps for accurate Bayesian inference and are often computationally infeasible for large-scale inverse problems, such as seismic imaging. Our main contribution is a data-driven variational inference approach where we train a normalizing flow (NF), a type of invertible neural net, capable of cheaply sampling the posterior distribution given previously unseen seismic data from neighboring surveys. To arrive at this result, we train the NF on pairs of low- and high-fidelity migrated images. In our numerical example, we obtain high-fidelity images from the Parihaka dataset and low-fidelity images are derived from these images through the process of demigration, followed by adding noise and migration. During inference, given shot records from a new neighboring seismic survey, we first compute the reverse-time migration image. Next, by feeding this low-fidelity migrated image to the NF we gain access to samples from the posterior distribution virtually for free. We use these samples to compute a high-fidelity image including a first assessment of the image's reliability. To our knowledge, this is the first attempt to train a conditional network on what we know from neighboring images to improve the current image and assess its reliability. △ Less

Submitted 13 April, 2021; originally announced April 2021.

Ultra-low memory seismic inversion with randomized trace estimation

Authors: Mathias Louboutin, Felix J. Herrmann

Abstract: Inspired by recent work on extended image volumes that lays the ground for randomized probing of extremely large seismic wavefield matrices, we present a memory frugal and computationally efficient inversion methodology that uses techniques from randomized linear algebra. By means of a carefully selected realistic synthetic example, we demonstrate that we are capable of achieving competitive inver… ▽ More Inspired by recent work on extended image volumes that lays the ground for randomized probing of extremely large seismic wavefield matrices, we present a memory frugal and computationally efficient inversion methodology that uses techniques from randomized linear algebra. By means of a carefully selected realistic synthetic example, we demonstrate that we are capable of achieving competitive inversion results at a fraction of the memory cost of conventional full-waveform inversion with limited computational overhead. By exchanging memory for negligible computational overhead, we open with the presented technology the door towards the use of low-memory accelerators such as GPUs. △ Less

Submitted 1 April, 2021; originally announced April 2021.

Ultra-low-power second-order nonlinear optics on a chip

Authors: Timothy P. McKenna, Hubert S. Stokowski, Vahid Ansari, Jatadhari Mishra, Marc Jankowski, Christopher J. Sarabalis, Jason F. Herrmann, Carsten Langrock, Martin M. Fejer, Amir H. Safavi-Naeini

Abstract: Second-order nonlinear optical processes are used to convert light from one wavelength to another and to generate quantum entanglement. Creating chip-scale devices to more efficiently realize and control these interactions greatly increases the reach of photonics. Optical crystals and guided wave devices made from lithium niobate and potassium titanyl phosphate are typically used to realize second… ▽ More Second-order nonlinear optical processes are used to convert light from one wavelength to another and to generate quantum entanglement. Creating chip-scale devices to more efficiently realize and control these interactions greatly increases the reach of photonics. Optical crystals and guided wave devices made from lithium niobate and potassium titanyl phosphate are typically used to realize second-order processes but face significant drawbacks in scalability, power, and tailorability when compared to emerging integrated photonic systems. Silicon or silicon nitride integrated photonic circuits enhance and control the third-order optical nonlinearity by confining light in dispersion-engineered waveguides and resonators. An analogous platform for second-order nonlinear optics remains an outstanding challenge in photonics. It would enable stronger interactions at lower power and reduce the number of competing nonlinear processes that emerge. Here we demonstrate efficient frequency doubling and parametric oscillation in a thin-film lithium niobate photonic circuit. Our device combines recent progress on periodically poled thin-film lithium niobate waveguidesand low-loss microresonators. Here we realize efficient >10% second-harmonic generation and parametric oscillation with microwatts of optical power using a periodically-poled thin-film lithium niobate microresonator. The operating regimes of this system are controlled using the relative detuning of the intracavity resonances. During nondegenerate oscillation, the emission wavelength is tuned over terahertz by varying the pump frequency by 100's of megahertz. We observe highly-enhanced effective third-order nonlinearities caused by cascaded second-order processes resulting in parametric oscillation. These resonant second-order nonlinear circuits will form a crucial part of the emerging nonlinear and quantum photonics platforms. △ Less

Submitted 10 February, 2021; originally announced February 2021.

Comments: 14 pages, 8 figures. Equal contribution by the first two authors

Preconditioned training of normalizing flows for variational inference in inverse problems

Authors: Ali Siahkoohi, Gabrio Rizzuti, Mathias Louboutin, Philipp A. Witte, Felix J. Herrmann

Abstract: Obtaining samples from the posterior distribution of inverse problems with expensive forward operators is challenging especially when the unknowns involve the strongly heterogeneous Earth. To meet these challenges, we propose a preconditioning scheme involving a conditional normalizing flow (NF) capable of sampling from a low-fidelity posterior distribution directly. This conditional NF is used to… ▽ More Obtaining samples from the posterior distribution of inverse problems with expensive forward operators is challenging especially when the unknowns involve the strongly heterogeneous Earth. To meet these challenges, we propose a preconditioning scheme involving a conditional normalizing flow (NF) capable of sampling from a low-fidelity posterior distribution directly. This conditional NF is used to speed up the training of the high-fidelity objective involving minimization of the Kullback-Leibler divergence between the predicted and the desired high-fidelity posterior density for indirect measurements at hand. To minimize costs associated with the forward operator, we initialize the high-fidelity NF with the weights of the pretrained low-fidelity NF, which is trained beforehand on available model and data pairs. Our numerical experiments, including a 2D toy and a seismic compressed sensing example, demonstrate that thanks to the preconditioning considerable speed-ups are achievable compared to training NFs from scratch. △ Less

Submitted 11 January, 2021; originally announced January 2021.

A dual formulation of wavefield reconstruction inversion for large-scale seismic inversion

Authors: Gabrio Rizzuti, Mathias Louboutin, Rongrong Wang, Felix J. Herrmann

Abstract: Most of the seismic inversion techniques currently proposed focus on robustness with respect to the background model choice or inaccurate physical modeling assumptions, but are not apt to large-scale 3D applications. On the other hand, methods that are computationally feasible for industrial problems, such as full waveform inversion, are notoriously bogged down by local minima and require adequate… ▽ More Most of the seismic inversion techniques currently proposed focus on robustness with respect to the background model choice or inaccurate physical modeling assumptions, but are not apt to large-scale 3D applications. On the other hand, methods that are computationally feasible for industrial problems, such as full waveform inversion, are notoriously bogged down by local minima and require adequate starting models. We propose a novel solution that is both scalable and less sensitive to starting model or inaccurate physics when compared to full waveform inversion. The method is based on a dual (Lagrangian) reformulation of the classical wavefield reconstruction inversion, whose robustness with respect to local minima is well documented in the literature. However, it is not suited to 3D, as it leverages expensive frequency-domain solvers for the wave equation. The proposed reformulation allows the deployment of state-of-the-art time-domain finite-difference methods, and is computationally mature for industrial scale problems. △ Less

Submitted 21 April, 2021; v1 submitted 18 October, 2020; originally announced October 2020.

Faster Uncertainty Quantification for Inverse Problems with Conditional Normalizing Flows

Authors: Ali Siahkoohi, Gabrio Rizzuti, Philipp A. Witte, Felix J. Herrmann

Abstract: In inverse problems, we often have access to data consisting of paired samples $(x,y)\sim p_{X,Y}(x,y)$ where $y$ are partial observations of a physical system, and $x$ represents the unknowns of the problem. Under these circumstances, we can employ supervised training to learn a solution $x$ and its uncertainty from the observations $y$. We refer to this problem as the "supervised" case. However,… ▽ More In inverse problems, we often have access to data consisting of paired samples $(x,y)\sim p_{X,Y}(x,y)$ where $y$ are partial observations of a physical system, and $x$ represents the unknowns of the problem. Under these circumstances, we can employ supervised training to learn a solution $x$ and its uncertainty from the observations $y$. We refer to this problem as the "supervised" case. However, the data $y\sim p_{Y}(y)$ collected at one point could be distributed differently than observations $y'\sim p_{Y}'(y')$, relevant for a current set of problems. In the context of Bayesian inference, we propose a two-step scheme, which makes use of normalizing flows and joint data to train a conditional generator $q_θ(x|y)$ to approximate the target posterior density $p_{X|Y}(x|y)$. Additionally, this preliminary phase provides a density function $q_θ(x|y)$, which can be recast as a prior for the "unsupervised" problem, e.g.~when only the observations $y'\sim p_{Y}'(y')$, a likelihood model $y'|x$, and a prior on $x'$ are known. We then train another invertible generator with output density $q'_φ(x|y')$ specifically for $y'$, allowing us to sample from the posterior $p_{X|Y}'(x|y')$. We present some synthetic results that demonstrate considerable training speedup when reusing the pretrained network $q_θ(x|y')$ as a warm start or preconditioning for approximating $p_{X|Y}'(x|y')$, instead of learning from scratch. This training modality can be interpreted as an instance of transfer learning. This result is particularly relevant for large-scale inverse problems that employ expensive numerical simulations. △ Less

Submitted 15 July, 2020; originally announced July 2020.

MPGD-based photon detectors for the upgrade of COMPASS RICH-1 and beyond

Authors: J. Agarwala, M. Alexeev, C. D. R. Azevedo, F. Bradamante, A. Bressan, M. Buchele, C. Chatterjee, M. Chiosso, A. Cicuttin, P. Ciliberti, M. L. Crespo, S. Dalla Torre, S. Dasgupta, O. Denisov, M. Finger, M. Finger Jr, H. Fischer, L. García Ordóñez, M. Gregori, G. Hamar, F. Herrmann, S. Levorato, A. Martin, G. Menon, D. Panzieri , et al. (7 additional authors not shown)

Abstract: COMPASS is a fixed target experiment at CERN SPS aimed to study hadron structure and spectroscopy. Hadron identification in the momentum range between $3$ and $55 GeV/c$ is provided by a large gaseous Ring Imaging Cherenkov Counter, RICH-1. To cope with the challenges imposed by the new physics program of COMPASS, RICH-1 has been upgraded by replacing four MWPC-based photon detectors with newly de… ▽ More COMPASS is a fixed target experiment at CERN SPS aimed to study hadron structure and spectroscopy. Hadron identification in the momentum range between $3$ and $55 GeV/c$ is provided by a large gaseous Ring Imaging Cherenkov Counter, RICH-1. To cope with the challenges imposed by the new physics program of COMPASS, RICH-1 has been upgraded by replacing four MWPC-based photon detectors with newly developed MPGD-based photon detectors. The architecture of the novel detectors is a hybrid combination of two layers of THGEMs and a Micromegas. The top of the first THGEM is coated with CsI acting as a reflective photo-cathode. The anode is segmented in pads capacitively coupled to the APV-25 based readout. The new hybrid detectors have been commissioned during the 2016 COMPASS data taking and stably operated during the 2017 run. In this paper design, construction, operation and performance aspects of the novel photon detectors for COMPASS RICH-1 are discussed. △ Less

Submitted 18 June, 2020; originally announced June 2020.

Comments: 11 Pages; 9 Figures; 8 Sections including References; 18 References; Proceedings for INSTR20 conference accepted in JINST for publication

The local balance laws for energy, momentum and entropy: how they came into being, and what was their destiny

Authors: Friedrich Herrmann

Abstract: The historical process of the genesis of the extensive or substance-like quantities took place in two steps. First, global conservation or non-conservation was discovered. Only later did it become possible to formulate the balance locally in the form of a continuity equation. This process can be clearly seen in energy, momentum, and entropy. After a long and intricate history, the quantitative des… ▽ More The historical process of the genesis of the extensive or substance-like quantities took place in two steps. First, global conservation or non-conservation was discovered. Only later did it become possible to formulate the balance locally in the form of a continuity equation. This process can be clearly seen in energy, momentum, and entropy. After a long and intricate history, the quantitative description of the local balance has been achieved for all of the three quantities in a surprisingly short period of time around the turn of the 19th to the 20th century. The new ideas could have simplified considerably the teaching of energy, momentum, and entropy. However, in all three cases, today's language of physics remained essentially the same as it was at the time when a local balancing was not yet possible. △ Less

Submitted 24 May, 2020; originally announced May 2020.

Comments: 8 pages

Journal ref: MNU, Heft 2/2015, (68. Jg.), p. 68

Cryogenic microwave-to-optical conversion using a triply-resonant lithium niobate on sapphire transducer

Authors: Timothy P. McKenna, Jeremy D. Witmer, Rishi N. Patel, Wentao Jiang, Raphaël Van Laer, Patricio Arrangoiz-Arriola, E. Alex Wollack, Jason F. Herrmann, Amir H. Safavi-Naeini

Abstract: Quantum networks are likely to have a profound impact on the way we compute and communicate in the future. In order to wire together superconducting quantum processors over kilometer-scale distances, we need transducers that can generate entanglement between the microwave and optical domains with high fidelity. We present an integrated electro-optic transducer that combines low-loss lithium niobat… ▽ More Quantum networks are likely to have a profound impact on the way we compute and communicate in the future. In order to wire together superconducting quantum processors over kilometer-scale distances, we need transducers that can generate entanglement between the microwave and optical domains with high fidelity. We present an integrated electro-optic transducer that combines low-loss lithium niobate photonics with superconducting microwave resonators on a sapphire substrate. Our triply-resonant device operates in a dilution refrigerator and converts microwave photons to optical photons with an on-chip efficiency of $6.6\times 10^{-6}$ and a conversion bandwidth of 20 MHz. We discuss design trade-offs in this device, including strategies to manage acoustic loss, and outline ways to increase the conversion efficiency in the future. △ Less

Submitted 2 May, 2020; originally announced May 2020.

Comments: 15 pages, 10 figures. First two authors contributed equally to this work

Scaling through abstractions -- high-performance vectorial wave simulations for seismic inversion with Devito

Authors: Mathias Louboutin, Fabio Luporini, Philipp Witte, Rhodri Nelson, George Bisbas, Jan Thorbecke, Felix J. Herrmann, Gerard Gorman

Abstract: [Devito] is an open-source Python project based on domain-specific language and compiler technology. Driven by the requirements of rapid HPC applications development in exploration seismology, the language and compiler have evolved significantly since inception. Sophisticated boundary conditions, tensor contractions, sparse operations and features such as staggered grids and sub-domains are all su… ▽ More [Devito] is an open-source Python project based on domain-specific language and compiler technology. Driven by the requirements of rapid HPC applications development in exploration seismology, the language and compiler have evolved significantly since inception. Sophisticated boundary conditions, tensor contractions, sparse operations and features such as staggered grids and sub-domains are all supported; operators of essentially arbitrary complexity can be generated. To accommodate this flexibility whilst ensuring performance, data dependency analysis is utilized to schedule loops and detect computational-properties such as parallelism. In this article, the generation and simulation of MPI-parallel propagators (along with their adjoints) for the pseudo-acoustic wave-equation in tilted transverse isotropic media and the elastic wave-equation are presented. Simulations are carried out on industry scale synthetic models in a HPC Cloud system and reach a performance of 28TFLOP/s, hence demonstrating Devito's suitability for production-grade seismic inversion problems. △ Less

Submitted 22 April, 2020; originally announced April 2020.

Comments: 11 pages, 3 figures

Parameterizing uncertainty by deep invertible networks, an application to reservoir characterization

Authors: Gabrio Rizzuti, Ali Siahkoohi, Philipp A. Witte, Felix J. Herrmann

Abstract: Uncertainty quantification for full-waveform inversion provides a probabilistic characterization of the ill-conditioning of the problem, comprising the sensitivity of the solution with respect to the starting model and data noise. This analysis allows to assess the confidence in the candidate solution and how it is reflected in the tasks that are typically performed after imaging (e.g., stratigrap… ▽ More Uncertainty quantification for full-waveform inversion provides a probabilistic characterization of the ill-conditioning of the problem, comprising the sensitivity of the solution with respect to the starting model and data noise. This analysis allows to assess the confidence in the candidate solution and how it is reflected in the tasks that are typically performed after imaging (e.g., stratigraphic segmentation following reservoir characterization). Classically, uncertainty comes in the form of a probability distribution formulated from Bayesian principles, from which we seek to obtain samples. A popular solution involves Monte Carlo sampling. Here, we propose instead an approach characterized by training a deep network that "pushes forward" Gaussian random inputs into the model space (representing, for example, density or velocity) as if they were sampled from the actual posterior distribution. Such network is designed to solve a variational optimization problem based on the Kullback-Leibler divergence between the posterior and the network output distributions. This work is fundamentally rooted in recent developments for invertible networks. Special invertible architectures, besides being computational advantageous with respect to traditional networks, do also enable analytic computation of the output density function. Therefore, after training, these networks can be readily used as a new prior for a related inversion problem. This stands in stark contrast with Monte-Carlo methods, which only produce samples. We validate these ideas with an application to angle-versus-ray parameter analysis for reservoir characterization. △ Less

Submitted 16 April, 2020; originally announced April 2020.

Extended source imaging, a unifying framework for seismic & medical imaging

Authors: Ziyi Yin, Rafael Orozco, Philipp Witte, Mathias Louboutin, Gabrio Rizzuti, Felix J. Herrmann

Abstract: We present three imaging modalities that live on the crossroads of seismic and medical imaging. Through the lens of extended source imaging, we can draw deep connections among the fields of wave-equation based seismic and medical imaging, despite first appearances. From the seismic perspective, we underline the importance to work with the correct physics and spatially varying velocity fields. Medi… ▽ More We present three imaging modalities that live on the crossroads of seismic and medical imaging. Through the lens of extended source imaging, we can draw deep connections among the fields of wave-equation based seismic and medical imaging, despite first appearances. From the seismic perspective, we underline the importance to work with the correct physics and spatially varying velocity fields. Medical imaging, on the other hand, opens the possibility for new imaging modalities where outside stimuli, such as laser or radar pulses, can not only be used to identify endogenous optical or thermal contrasts but that these sources can also be used to insonify the medium so that images of the whole specimen can in principle be created. △ Less

Submitted 15 April, 2020; originally announced April 2020.

Comments: Submitted to the Society of Exploration Geophysicists Annual Meeting 2020

Transfer learning in large-scale ocean bottom seismic wavefield reconstruction

Authors: Mi Zhang, Ali Siahkoohi, Felix J. Herrmann

Abstract: Achieving desirable receiver sampling in ocean bottom acquisition is often not possible because of cost considerations. Assuming adequate source sampling is available, which is achievable by virtue of reciprocity and the use of modern randomized (simultaneous-source) marine acquisition technology, we are in a position to train convolutional neural networks (CNNs) to bring the receiver sampling to… ▽ More Achieving desirable receiver sampling in ocean bottom acquisition is often not possible because of cost considerations. Assuming adequate source sampling is available, which is achievable by virtue of reciprocity and the use of modern randomized (simultaneous-source) marine acquisition technology, we are in a position to train convolutional neural networks (CNNs) to bring the receiver sampling to the same spatial grid as the dense source sampling. To accomplish this task, we form training pairs consisting of densely sampled data and artificially subsampled data using a reciprocity argument and the assumption that the source-site sampling is dense. While this approach has successfully been used on the recovery monochromatic frequency slices, its application in practice calls for wavefield reconstruction of time-domain data. Despite having the option to parallelize, the overall costs of this approach can become prohibitive if we decide to carry out the training and recovery independently for each frequency. Because different frequency slices share information, we propose the use the method of transfer training to make our approach computationally more efficient by warm starting the training with CNN weights obtained from a neighboring frequency slices. If the two neighboring frequency slices share information, we would expect the training to improve and converge faster. Our aim is to prove this principle by carrying a series of carefully selected experiments on a relatively large-scale five-dimensional data synthetic data volume associated with wide-azimuth 3D ocean bottom node acquisition. From these experiments, we observe that by transfer training we are able t significantly speedup in the training, specially at relatively higher frequencies where consecutive frequency slices are more correlated. △ Less

Submitted 15 April, 2020; originally announced April 2020.

Time-domain Wavefield Reconstruction Inversion in a TTI medium

Authors: Mathias Louboutin, Gabrio Rizzuti, Felix J. Herrmann

Abstract: We introduce a generalization of time-domain wavefield reconstruction inversion to anisotropic acoustic modeling. Wavefield reconstruction inversion has been extensively researched in recent years for its ability to mitigate cycle skip**. The original method was formulated in the frequency domain with acoustic isotropic physics. However, frequency-domain modeling requires sophisticated iterative… ▽ More We introduce a generalization of time-domain wavefield reconstruction inversion to anisotropic acoustic modeling. Wavefield reconstruction inversion has been extensively researched in recent years for its ability to mitigate cycle skip**. The original method was formulated in the frequency domain with acoustic isotropic physics. However, frequency-domain modeling requires sophisticated iterative solvers that are difficult to scale to industrial-size problems and more realistic physical assumptions, such as tilted transverse isotropy, object of this study. The work presented here is based on a recently proposed dual formulation of wavefield reconstruction inversion, which allows time-domain propagator that are suitable to both large scales and more accurate physics. △ Less

Submitted 15 April, 2020; originally announced April 2020.

Comments: 9 pages

Weak deep priors for seismic imaging

Authors: Ali Siahkoohi, Gabrio Rizzuti, Felix J. Herrmann

Abstract: Incorporating prior knowledge on model unknowns of interest is essential when dealing with ill-posed inverse problems due to the nonuniqueness of the solution and data noise. Unfortunately, it is not trivial to fully describe our priors in a convenient and analytical way. Parameterizing the unknowns with a convolutional neural network (CNN), and assuming an uninformative Gaussian prior on its weig… ▽ More Incorporating prior knowledge on model unknowns of interest is essential when dealing with ill-posed inverse problems due to the nonuniqueness of the solution and data noise. Unfortunately, it is not trivial to fully describe our priors in a convenient and analytical way. Parameterizing the unknowns with a convolutional neural network (CNN), and assuming an uninformative Gaussian prior on its weights, leads to a variational prior on the output space that favors "natural" images and excludes noisy artifacts, as long as overfitting is prevented. This is the so-called deep-prior approach. In seismic imaging, however, evaluating the forward operator is computationally expensive, and training a randomly initialized CNN becomes infeasible. We propose, instead, a weak version of deep priors, which consists of relaxing the requirement that reflectivity models must lie in the network range, and letting the unknowns deviate from the network output according to a Gaussian distribution. Finally, we jointly solve for the reflectivity model and CNN weights. The chief advantage of this approach is that the updates for the CNN weights do not involve the modeling operator, and become relatively cheap. Our synthetic numerical experiments demonstrate that the weak deep prior is more robust with respect to noise than conventional least-squares imaging approaches, with roughly twice the computational cost of reverse-time migration, which is the affordable computational budget in large-scale imaging problems. △ Less

Submitted 23 June, 2021; v1 submitted 14 April, 2020; originally announced April 2020.

Uncertainty quantification in imaging and automatic horizon tracking: a Bayesian deep-prior based approach

Authors: Ali Siahkoohi, Gabrio Rizzuti, Felix J. Herrmann

Abstract: In inverse problems, uncertainty quantification (UQ) deals with a probabilistic description of the solution nonuniqueness and data noise sensitivity. Setting seismic imaging into a Bayesian framework allows for a principled way of studying uncertainty by solving for the model posterior distribution. Imaging, however, typically constitutes only the first stage of a sequential workflow, and UQ becom… ▽ More In inverse problems, uncertainty quantification (UQ) deals with a probabilistic description of the solution nonuniqueness and data noise sensitivity. Setting seismic imaging into a Bayesian framework allows for a principled way of studying uncertainty by solving for the model posterior distribution. Imaging, however, typically constitutes only the first stage of a sequential workflow, and UQ becomes even more relevant when applied to subsequent tasks that are highly sensitive to the inversion outcome. In this paper, we focus on how UQ trickles down to horizon tracking for the determination of stratigraphic models and investigate its sensitivity with respect to the imaging result. As such, the main contribution of this work consists in a data-guided approach to horizon tracking uncertainty analysis. This work is fundamentally based on a special reparameterization of reflectivity, known as "deep prior". Feasible models are restricted to the output of a convolutional neural network with a fixed input, while weights and biases are Gaussian random variables. Given a deep prior model, the network parameters are sampled from the posterior distribution via a Markov chain Monte Carlo method, from which the conditional mean and point-wise standard deviation of the inferred reflectivities are approximated. For each sample of the posterior distribution, a reflectivity is generated, and the horizons are tracked automatically. In this way, uncertainty on model parameters naturally translates to horizon tracking. As part of the validation for the proposed approach, we verified that the estimated confidence intervals for the horizon tracking coincide with geologically complex regions, such as faults. △ Less

Submitted 14 April, 2020; v1 submitted 1 April, 2020; originally announced April 2020.

Time-domain sparsity promoting least-squares reverse time migration with source estimation

Authors: Mengmeng Yang, Zhilong Fang, Philipp Witte, Felix J. Herrmann

Abstract: Least-squares reverse time migration is well-known for its capability to generate artifact-free true-amplitude subsurface images through fitting observed data in the least-squares sense. However, when applied to realistic imaging problems, this approach is faced with issues related to overfitting and excessive computational costs induced by many wave-equation solves. The fact that the source funct… ▽ More Least-squares reverse time migration is well-known for its capability to generate artifact-free true-amplitude subsurface images through fitting observed data in the least-squares sense. However, when applied to realistic imaging problems, this approach is faced with issues related to overfitting and excessive computational costs induced by many wave-equation solves. The fact that the source function is unknown complicates this situation even further. Motivated by recent results in stochastic optimization and transform-domain sparsity-promotion, we demonstrate that the computational costs of inversion can be reduced significantly while avoiding imaging artifacts and restoring amplitudes. While powerful, these new approaches do require accurate information on the source-time function, which is often lacking. Without this information, the imaging quality deteriorates rapidly. We address this issue by presenting an approach where the source-time function is estimated on the fly through a technique known as variable projection. Aside from introducing negligible computational overhead, the proposed method is shown to perform well on imaging problems with noisy data and problems that involve complex settings such as salt. In either case, the presented method produces high resolution high-amplitude fidelity images including an estimates for the source-time function. In addition, due to its use of stochastic optimization, we arrive at these images at roughly one to two times the cost of conventional reverse time migration involving all data. △ Less

Submitted 2 March, 2020; originally announced March 2020.

A deep-learning based Bayesian approach to seismic imaging and uncertainty quantification

Authors: Ali Siahkoohi, Gabrio Rizzuti, Felix J. Herrmann

Abstract: Uncertainty quantification is essential when dealing with ill-conditioned inverse problems due to the inherent nonuniqueness of the solution. Bayesian approaches allow us to determine how likely an estimation of the unknown parameters is via formulating the posterior distribution. Unfortunately, it is often not possible to formulate a prior distribution that precisely encodes our prior knowledge a… ▽ More Uncertainty quantification is essential when dealing with ill-conditioned inverse problems due to the inherent nonuniqueness of the solution. Bayesian approaches allow us to determine how likely an estimation of the unknown parameters is via formulating the posterior distribution. Unfortunately, it is often not possible to formulate a prior distribution that precisely encodes our prior knowledge about the unknown. Furthermore, adherence to handcrafted priors may greatly bias the outcome of the Bayesian analysis. To address this issue, we propose to use the functional form of a randomly initialized convolutional neural network as an implicit structured prior, which is shown to promote natural images and excludes images with unnatural noise. In order to incorporate the model uncertainty into the final estimate, we sample the posterior distribution using stochastic gradient Langevin dynamics and perform Bayesian model averaging on the obtained samples. Our synthetic numerical experiment verifies that deep priors combined with Bayesian model averaging are able to partially circumvent imaging artifacts and reduce the risk of overfitting in the presence of extreme noise. Finally, we present pointwise variance of the estimates as a measure of uncertainty, which coincides with regions that are more difficult to image. △ Less

Submitted 14 January, 2020; v1 submitted 13 January, 2020; originally announced January 2020.