Showing 1–50 of 487 results for author: Berg, V

Error mitigation with stabilized noise in superconducting quantum processors

Authors: Youngseok Kim, Luke C. G. Govia, Andrew Dane, Ewout van den Berg, David M. Zajac, Bradley Mitchell, Yinyu Liu, Karthik Balakrishnan, George Keefe, Adam Stabile, Emily Pritchett, Jiri Stehlik, Abhinav Kandala

Abstract: Pre-fault tolerant quantum computers have already demonstrated the ability to estimate observable values accurately, at a scale beyond brute-force classical computation. This has been enabled by error mitigation techniques that often rely on a representative model on the device noise. However, learning and maintaining these models is complicated by fluctuations in the noise over unpredictable time… ▽ More Pre-fault tolerant quantum computers have already demonstrated the ability to estimate observable values accurately, at a scale beyond brute-force classical computation. This has been enabled by error mitigation techniques that often rely on a representative model on the device noise. However, learning and maintaining these models is complicated by fluctuations in the noise over unpredictable time scales, for instance, arising from resonant interactions between superconducting qubits and defect two-level systems (TLS). Such interactions affect the stability and uniformity of device performance as a whole, but also affect the noise model accuracy, leading to incorrect observable estimation. Here, we experimentally demonstrate that tuning of the qubit-TLS interactions helps reduce noise instabilities and consequently enables more reliable error-mitigation performance. These experiments provide a controlled platform for studying the performance of error mitigation in the presence of quasi-static noise. We anticipate that the capabilities introduced here will be crucial for the exploration of quantum applications on solid-state processors at non-trivial scales. △ Less

Submitted 5 July, 2024; v1 submitted 2 July, 2024; originally announced July 2024.

Comments: 8 pages, 4 figures (13 pages, 8 figures for supplementary material), reference numbering has been fixed at v2

A detailed survey of the parallel mean free path of solar energetic particle protons and electrons

Authors: J. T. Lang, R. D. Strauss, N. E. Engelbrecht, J. P. van den Berg, N. Dresing, D. Ruffolo, R. Bandyopadhyay

Abstract: In this work, more than a dozen solar energetic particle (SEP) events are identified where the source region is magnetically well-connected to at least one spacecraft at 1~au. The observed intensity-time profiles, for all available proton and electron energy channels, are compared to results computed using a numerical 1D SEP transport model in order to derive the parallel mean free paths (pMFPs) a… ▽ More In this work, more than a dozen solar energetic particle (SEP) events are identified where the source region is magnetically well-connected to at least one spacecraft at 1~au. The observed intensity-time profiles, for all available proton and electron energy channels, are compared to results computed using a numerical 1D SEP transport model in order to derive the parallel mean free paths (pMFPs) as a function of energy (or rigidity) at 1~au. These inversion results are then compared to theoretical estimates of the pMFP, using observed turbulence quantities with observationally-motivated variations as input. For protons, a very good comparison between inversion and theoretical results is obtained. It is shown that the observed inter-event variations in the inversion pMFP values can be explained by natural variations in the background turbulence values. For electrons, there is relatively good agreement with pMFPs derived assuming the dam** model of dynamical turbulence, although the theoretical values are extremely sensitive to the details of the turbulence dissipation range which themselves display a high level of variation. △ Less

Submitted 9 June, 2024; originally announced June 2024.

Comments: Accepted to ApJ

Periodic localized traveling waves in the two-dimensional suspension bridge equation

Authors: Lindsey van der Aalst, Jan Bouwe van den Berg, Jean-Philippe Lessard

Abstract: In the dynamics generated by the suspension bridge equation, traveling waves are an essential feature. The existing literature focuses primarily on the idealized one-dimensional case, while traveling structures in two spatial dimensions have only been studied via numerical simulations. We use computer-assisted proof methods based on a Newton-Kantorovich type argument to find and prove periodic loc… ▽ More In the dynamics generated by the suspension bridge equation, traveling waves are an essential feature. The existing literature focuses primarily on the idealized one-dimensional case, while traveling structures in two spatial dimensions have only been studied via numerical simulations. We use computer-assisted proof methods based on a Newton-Kantorovich type argument to find and prove periodic localized traveling waves in two dimensions. The main obstacle is the exponential nonlinearity in combination with the resulting large amplitude of the localized waves. Our analysis hinges on establishing computable bounds to control the aliasing error in the computed Fourier coefficients. This leads to existence proofs of different traveling wave solutions, accompanied by small, explicit, rigorous bounds on the deficiency of numerical approximations. This approach is directly extendable to other wave equation models and elliptic partial differential equations with analytic nonlinearities, in two as well as in higher dimensions. △ Less

Submitted 2 July, 2024; v1 submitted 30 May, 2024; originally announced May 2024.

Comments: Added a reference

Simultaneous Chandra and HST observations of the quiescent neutron-star low-mass X-ray binaries in 47 Tucanae

Authors: Maureen van den Berg, Liliana Rivera Sandoval, Craig O. Heinke, Haldan N. Cohn, Phyllis M. Lugger, Jonathan E. Grindlay, Peter D. Edmonds, Jay Anderson, Andrei Catuneanu

Abstract: We present simultaneous Chandra X-ray Observatory and Hubble Space Telescope observations of three certain (X5, X7, W37) and two likely (X4, W17) quiescent neutron-star low-mass X-ray binaries (qLMXBs) in the globular cluster 47 Tuc. We study these systems in the X-ray, optical and near-ultraviolet (NUV) using the simultaneous data and additional non-contemporaneous HST data. We have discovered a… ▽ More We present simultaneous Chandra X-ray Observatory and Hubble Space Telescope observations of three certain (X5, X7, W37) and two likely (X4, W17) quiescent neutron-star low-mass X-ray binaries (qLMXBs) in the globular cluster 47 Tuc. We study these systems in the X-ray, optical and near-ultraviolet (NUV) using the simultaneous data and additional non-contemporaneous HST data. We have discovered a blue and variable NUV counterpart to W17. We have not securely identified the eclipsing qLMXB W37 in the optical or NUV. Deeper high-resolution imaging is needed to further investigate the faint NUV excess near the centre of the W37 error circle. We suggest that a previously identified optical astrometric match to X7 is likely the true counterpart. The Halpha emission and the location of the counterpart in the colour-magnitude diagram, indicate that the secondary is probably a non-degenerate, H-rich star. This is consistent with previous results from fitting X7's X-ray spectrum. In X4, the simultaneous X-ray and optical behaviour supports the earlier suggestion that the X-ray variability is driven by changes in accretion rate. The X-ray eclipses in X5 coincide with minima in the optical/NUV light curves. Comparison of the 47 Tuc qLMXBs with the cataclysmic variables (CVs) in the cluster confirms that overall the qLMXBs have larger X-ray-to-optical flux ratios. Based on their optical/NUV colors, we conclude that the accretion disks in the qLMXBs are less prominent than in CVs. This makes the ratio of X-ray flux to excess blue optical flux a powerful discriminator between CVs and qLMXBs. △ Less

Submitted 23 April, 2024; originally announced April 2024.

Comments: accepted by MNRAS

The Frobenius equivalence and Beck-Chevalley condition for Algebraic Weak Factorisation Systems

Authors: Wijnand van Woerkom, Benno van den Berg

Abstract: If a locally cartesian closed category carries a weak factorisation system, then the left maps are stable under pullback along right maps if and only if the right maps are closed under pushforward along right maps. We refer to this statement as the Frobenius equivalence and in this paper we state and prove an analogical statement for algebraic weak factorisation systems. These algebraic weak facto… ▽ More If a locally cartesian closed category carries a weak factorisation system, then the left maps are stable under pullback along right maps if and only if the right maps are closed under pushforward along right maps. We refer to this statement as the Frobenius equivalence and in this paper we state and prove an analogical statement for algebraic weak factorisation systems. These algebraic weak factorisation systems are an explicit variant of the more traditional weak factorisation systems in that the factorisation and the lifts are part of the structure of an algebraic weak factorisation system and are not merely required to exist. Our work has been motivated by the categorical semantics of type theory, where the Frobenius equivalence provides a useful tool for constructing dependent function types. We illustrate our ideas using split fibrations of groupoids, which are the backbone of the groupoid model of Hofmann and Streicher. △ Less

Submitted 23 April, 2024; originally announced April 2024.

MSC Class: 18A32; 18N10; 03B38

Segmentation tool for images of cracks

Authors: Andrii Kompanets, Remco Duits, Davide Leonetti, Nicky van den Berg, H. H., Snijder

Abstract: Safety-critical infrastructures, such as bridges, are periodically inspected to check for existing damage, such as fatigue cracks and corrosion, and to guarantee the safe use of the infrastructure. Visual inspection is the most frequent type of general inspection, despite the fact that its detection capability is rather limited, especially for fatigue cracks. Machine learning algorithms can be use… ▽ More Safety-critical infrastructures, such as bridges, are periodically inspected to check for existing damage, such as fatigue cracks and corrosion, and to guarantee the safe use of the infrastructure. Visual inspection is the most frequent type of general inspection, despite the fact that its detection capability is rather limited, especially for fatigue cracks. Machine learning algorithms can be used for augmenting the capability of classical visual inspection of bridge structures, however, the implementation of such an algorithm requires a massive annotated training dataset, which is time-consuming to produce. This paper proposes a semi-automatic crack segmentation tool that eases the manual segmentation of cracks on images needed to create a training dataset for a machine learning algorithm. Also, it can be used to measure the geometry of the crack. This tool makes use of an image processing algorithm, which was initially developed for the analysis of vascular systems on retinal images. The algorithm relies on a multi-orientation wavelet transform, which is applied to the image to construct the so-called "orientation scores", i.e. a modified version of the image. Afterwards, the filtered orientation scores are used to formulate an optimal path problem that identifies the crack. The globally optimal path between manually selected crack endpoints is computed, using a state-of-the-art geometric tracking method. The pixel-wise segmentation is done afterwards using the obtained crack path. The proposed method outperforms fully automatic methods and shows potential to be an adequate alternative to the manual data annotation. △ Less

Submitted 28 March, 2024; originally announced March 2024.

Time-efficient, high-resolution 3T whole-brain relaxometry using Cartesian 3D MR-STAT with CSF suppression

Authors: Hongyan Liu, Edwin Versteeg, Miha Fuderer, Oscar van der Heide, Martin B. Schilder, Cornelis A. T. van den Berg, Alessandro Sbrizzi

Abstract: Purpose: Current 3D Magnetic Resonance Spin TomogrAphy in Time-domain (MR-STAT) protocols use transient-state, gradient-spoiled gradient-echo sequences that are prone to cerebrospinal fluid (CSF) pulsation artifacts when applied to the brain. This study aims at develo** a 3D MR-STAT protocol for whole-brain relaxometry that overcomes the challenges posed by CSF-induced ghosting artifacts. Method… ▽ More Purpose: Current 3D Magnetic Resonance Spin TomogrAphy in Time-domain (MR-STAT) protocols use transient-state, gradient-spoiled gradient-echo sequences that are prone to cerebrospinal fluid (CSF) pulsation artifacts when applied to the brain. This study aims at develo** a 3D MR-STAT protocol for whole-brain relaxometry that overcomes the challenges posed by CSF-induced ghosting artifacts. Method: We optimized the flip-angle train within the Cartesian 3D MR-STAT framework to achieve two objectives: (1) minimization of the noise level in the reconstructed quantitative maps, and (2) reduction of the CSF-to-white-matter signal ratio to suppress CSF signal and the associated pulsation artifacts. The optimized new sequence was tested on a gel/water-phantom to evaluate the accuracy of the quantitative maps, and on healthy volunteers to explore the effectiveness of the CSF artifact suppression and robustness of the new protocol. Results: A new optimized sequence with both high parameter encoding capability and low CSF intensity was proposed and initially validated in the gel/water-phantom experiment. From in-vivo experiments with five volunteers, the proposed CSF-suppressed sequence shows no CSF ghosting artifacts and overall greatly improved image quality for all quantitative maps compared to the baseline sequence. Statistical analysis indicated low inter-subject and inter-scan variability for quantitative parameters in gray matter and white matter (1.6%-2.4% for T1 and 2.0%-4.6% for T2), demonstrating the robustness of the new sequence. Conclusion: We presented a new 3D MR-STAT sequence with CSF suppression that effectively eliminates CSF pulsation artifacts. The new sequence ensures consistently high-quality, 1mm^3 whole-brain relaxometry within a rapid 5.5-minute scan time. △ Less

Submitted 22 March, 2024; originally announced March 2024.

Direct visualization of domain wall pinning in sub-100nm 3D magnetic nanowires with cross-sectional curvature

Authors: Joseph Askey, Matthew Oliver Hunt, Lukas Payne, Arjen van den Berg, Ioannis Pitsios, Alaa Hejazi, Wolfgang Langbein, Sam Ladak

Abstract: The study of 3D magnetic nanostructures has uncovered a range of rich phenomena including the stabilization and control of topological spin textures using nanoscale curvature, dynamic effects allowing controlled spin-wave emission, and novel ground states enabled by collective 3D frustrated interactions. From a technological perspective, 3D nanostructures offer routes to ultrahigh density data sto… ▽ More The study of 3D magnetic nanostructures has uncovered a range of rich phenomena including the stabilization and control of topological spin textures using nanoscale curvature, dynamic effects allowing controlled spin-wave emission, and novel ground states enabled by collective 3D frustrated interactions. From a technological perspective, 3D nanostructures offer routes to ultrahigh density data storage, massive interconnectivity within neuromorphic devices, as well as applications within health technologies, such as mechanical induction of stem cell differentiation. However, the fabrication of 3D nanomagnetic systems with feature sizes down to 10 nm poses a significant challenge. In this work we present a means of fabricating sub-100 nm 3D ferromagnetic nanowires, with both cross-sectional and longitudinal curvature, using two-photon lithography at a wavelength of 405 nm, combined with conventional deposition. Physical characterization illustrates that nanostructures with lateral features as low as 70 nm can be rapidly and reproducibly fabricated. A range of novel domain walls, with anti-vortex textures, coupled transverse textures, and hybrid vortex/anti-vortex textures are found to be enabled by the cross-sectional curvature of the system, as demonstrated by finite-element micromagnetic simulations. Magnetic force microscopy experiments in an externally applied magnetic field are used to image the injection and pinning of domain walls in the 3D magnetic nanowire. At specific field values, domain walls are observed to hop from trap to trap, providing a direct means to probe the local energy landscape. A simple model is presented demonstrating that thickness gradients and local roughness dictate the variation of pinning probability across the wire. △ Less

Submitted 7 March, 2024; originally announced March 2024.

On the torsion function for simply connected, open sets in $\R^2$

Authors: Michiel van den Berg, Dorin Bucur

Abstract: For an open set $\Om \subset \R^2$ let $λ(\Om)$ denote the bottom of the spectrum of the Dirichlet Laplacian acting in $L^2(\Om)$. Let $w_\Om$ be the torsion function for $\Om$, and let $\|.\|_p$ denote the $L^p$ norm. It is shown there exists $η>0$ such that $\|w_{\Om}\|_{\infty} λ(\Om)\ge 1+η$ for any non-empty, open, simply connected set $\Om\subset \R^2$ with $\lb(\Om) >0$. Moreover, if the me… ▽ More For an open set $\Om \subset \R^2$ let $λ(\Om)$ denote the bottom of the spectrum of the Dirichlet Laplacian acting in $L^2(\Om)$. Let $w_\Om$ be the torsion function for $\Om$, and let $\|.\|_p$ denote the $L^p$ norm. It is shown there exists $η>0$ such that $\|w_{\Om}\|_{\infty} λ(\Om)\ge 1+η$ for any non-empty, open, simply connected set $\Om\subset \R^2$ with $\lb(\Om) >0$. Moreover, if the measure $|\Om|$ of $\Om$ is finite, then $\|w_{\Om}\|_1λ(\Om)\le (1-η)|\Om|$. △ Less

Submitted 22 February, 2024; originally announced February 2024.

Comments: 18 pages, 1 figure

Examples and cofibrant generation of effective Kan fibrations

Authors: Benno van den Berg, Freek Geerligs

Abstract: We will show make two contributions to the theory of effective Kan fibrations, which are a more explicit version of the notion of a Kan fibration, a notion which plays a fundamental role in simplicial homotopy theory. We will show that simplicial Malcev algebras are effective Kan complexes and that the effective Kan fibrations can be seen as the right class in an algebraic weak factorisation syste… ▽ More We will show make two contributions to the theory of effective Kan fibrations, which are a more explicit version of the notion of a Kan fibration, a notion which plays a fundamental role in simplicial homotopy theory. We will show that simplicial Malcev algebras are effective Kan complexes and that the effective Kan fibrations can be seen as the right class in an algebraic weak factorisation system. In addition, we will introduce two strengthenings of the notion of an effective Kan fibration, the symmetric effective and degenerate-preferring Kan fibrations, and show that the previous results holds for these strengthenings as well. △ Less

Submitted 29 February, 2024; v1 submitted 16 February, 2024; originally announced February 2024.

Comments: Corrected typos and mild reorganisation

MSC Class: 18A32; 18N50; 55U10

Jovian electrons in the inner heliosphere: Opportunities for Multi-spacecraft Observations and Modeling

Authors: R. D. Strauss, N. Dresing, N. E. Engelbrecht, J. G. Mitchell, P. Kühl, S. Jensen, S. Fleth, B. Sánchez-Cano, A. Posner, J. S Rankin, C. O. Lee, J. P. van den Berg, S. E. S. Ferreira, B. Heber

Abstract: In this paper we explore the idea of using multi-spacecraft observations of Jovian electrons to measure the 3D distribution of these particles in the inner heliosphere. We present simulations of Jovian electron intensities along selected spacecraft trajectories for 2021 and compare these, admittedly qualitatively, to these measurements. Using the data-model comparison we emphasize how such a study… ▽ More In this paper we explore the idea of using multi-spacecraft observations of Jovian electrons to measure the 3D distribution of these particles in the inner heliosphere. We present simulations of Jovian electron intensities along selected spacecraft trajectories for 2021 and compare these, admittedly qualitatively, to these measurements. Using the data-model comparison we emphasize how such a study can be used to constrain the transport parameters in the inner heliosphere, and how this can lead to additional insight into energetic particle transport. Model results are also shown along the expected trajectories of selected spacecraft, including the off-ecliptic phase of the Solar Orbiter mission from 2025 onward. Lastly, we revisit the use of historical data and discuss upcoming missions that may contribute to Jovian electron measurements. △ Less

Submitted 6 December, 2023; originally announced January 2024.

Comments: Accepted for publication in ApJ

Discovery of a second eclipsing, bursting neutron-star low-mass X-ray binary in the globular cluster Terzan 6

Authors: Maureen van den Berg, Jeroen Homan, Craig O. Heinke, David A. Pooley, Rudy Wijnands, Arash Bahramian, James C. A. Miller-Jones

Abstract: We have analyzed Chandra and Suzaku observations of the globular cluster Terzan 6, made when the recurrent transient GRS 1747-312 was in quiescence. Our analysis reveals the presence of a second eclipsing, bursting neutron-star low-mass X-ray binary in the central regions of the cluster, in addition to GRS 1747-312. The new source, which we name Terzan 6 X2, is located only ~0.7 arcsec away from G… ▽ More We have analyzed Chandra and Suzaku observations of the globular cluster Terzan 6, made when the recurrent transient GRS 1747-312 was in quiescence. Our analysis reveals the presence of a second eclipsing, bursting neutron-star low-mass X-ray binary in the central regions of the cluster, in addition to GRS 1747-312. The new source, which we name Terzan 6 X2, is located only ~0.7 arcsec away from GRS 1747-312 in the 2021 Chandra images. The detection of a 5.14 ks-long eclipse in the light curve of X2 at a time not predicted by the ephemeris of GRS 1747-312 confirms that it is an unrelated source. Using the Suzaku light curve from 2009, which in addition to a type-I X-ray burst also showed an eclipse-like feature, we constrain the orbital period to be longer than 16.27 h. The 0.5-10 keV luminosities of X2 vary in the range of ~0.24-5.9x10^34 erg/s on time scales of months to years. We have identified a plausible optical counterpart of X2 in HST F606W and F814W images. This star varied by 2.7 mag in V_606 between epochs separated by years. In the cluster color-magnitude diagram, the variable counterpart lies in the blue-straggler region when it was optically bright, about 1.1-1.7 mag above the main-sequence turn-off. From the orbital period-density relation of Roche-lobe filling stars we find the mass-donor radius to be >0.8 Rsun. △ Less

Submitted 20 May, 2024; v1 submitted 1 January, 2024; originally announced January 2024.

Comments: Accepted by ApJ; the orbital period and X-ray ephemeris of Terzan X2 have been added as note in the proof

Techniques for learning sparse Pauli-Lindblad noise models

Authors: Ewout van den Berg, Pawel Wocjan

Abstract: Error-mitigation techniques such as probabilistic error cancellation and zero-noise extrapolation benefit from accurate noise models. The sparse Pauli-Lindblad noise model is one of the most successful models for those applications. In existing implementations, the model decomposes into a series of simple Pauli channels with one- and two-local terms that follow the qubit topology. While the model… ▽ More Error-mitigation techniques such as probabilistic error cancellation and zero-noise extrapolation benefit from accurate noise models. The sparse Pauli-Lindblad noise model is one of the most successful models for those applications. In existing implementations, the model decomposes into a series of simple Pauli channels with one- and two-local terms that follow the qubit topology. While the model has been shown to accurately capture the noise in contemporary superconducting quantum processors for error mitigation, it is important to consider higher-weight terms and effects beyond nearest-neighbor interactions. For such extended models to remain practical, however, we need to ensure that they can be learned efficiently. In this work we present new techniques that accomplish exactly this. We introduce twirling based on Pauli rotations, which enables us to automatically generate single-qubit learning correction sequences and reduce the number of unique fidelities that need to be learned. In addition, we propose a basis-selection strategy that leverages graph coloring and uniform covering arrays to minimize the number of learning bases. Taken together, these techniques ensure that the learning of the extended noise models remains efficient, despite their increased complexity. △ Less

Submitted 16 January, 2024; v1 submitted 26 November, 2023; originally announced November 2023.

Apartness and the elimination of strong forms of extensionality

Authors: Benno van den Berg

Abstract: We introduce a new version of arithmetic in all finite types which extends the usual versions with primitive notions of extensionality and extensional equality. This new hybrid version allows us to formulate a strong form of extensionality, which we call converse extensionality. Inspired by Brouwer's notion of apartness, we show that converse extensionality can be eliminated in a way which improve… ▽ More We introduce a new version of arithmetic in all finite types which extends the usual versions with primitive notions of extensionality and extensional equality. This new hybrid version allows us to formulate a strong form of extensionality, which we call converse extensionality. Inspired by Brouwer's notion of apartness, we show that converse extensionality can be eliminated in a way which improves on results from our previous work. We also explain how standard proof-theoretic interpretations, like realizability and functional interpretations, can be extended to such hybrid systems, and how that might be relevant to proof-mining. △ Less

Submitted 25 October, 2023; originally announced October 2023.

Probabilistic error cancellation for dynamic quantum circuits

Authors: Riddhi S. Gupta, Ewout van den Berg, Maika Takita, Diego Riste, Kristan Temme, Abhinav Kandala

Abstract: Probabilistic error cancellation (PEC) is a technique that generates error-mitigated estimates of expectation values from ensembles of quantum circuits. In this work we extend the application of PEC from unitary-only circuits to dynamic circuits with measurement-based operations, such as mid-circuit measurements and classically-controlled (feedforward) Clifford operations. Our approach extends the… ▽ More Probabilistic error cancellation (PEC) is a technique that generates error-mitigated estimates of expectation values from ensembles of quantum circuits. In this work we extend the application of PEC from unitary-only circuits to dynamic circuits with measurement-based operations, such as mid-circuit measurements and classically-controlled (feedforward) Clifford operations. Our approach extends the sparse Pauli-Lindblad noise model to measurement-based operations while accounting for non-local measurement crosstalk in superconducting processors. Our mitigation and monitoring experiments provide a holistic view for the performance of the protocols developed in this work. These capabilities will be a crucial tool in the exploration of near-term dynamic circuit applications. △ Less

Submitted 15 December, 2023; v1 submitted 11 October, 2023; originally announced October 2023.

Comments: Minor updates to v1

Time-Resolved Reconstruction of Motion, Force, and Stiffness using Spectro-Dynamic MRI

Authors: Max H. C. van Riel, Tristan van Leeuwen, Cornelis A. T. van den Berg, Alessandro Sbrizzi

Abstract: Measuring the dynamics and mechanical properties of muscles and joints is important to understand the (patho)physiology of muscles. However, acquiring dynamic time-resolved MRI data is challenging. We have previously developed Spectro-Dynamic MRI which allows the characterization of dynamical systems at a high spatial and temporal resolution directly from k-space data. This work presents an extend… ▽ More Measuring the dynamics and mechanical properties of muscles and joints is important to understand the (patho)physiology of muscles. However, acquiring dynamic time-resolved MRI data is challenging. We have previously developed Spectro-Dynamic MRI which allows the characterization of dynamical systems at a high spatial and temporal resolution directly from k-space data. This work presents an extended Spectro-Dynamic MRI framework that reconstructs 1) time-resolved MR images, 2) time-resolved motion fields, 3) dynamical parameters, and 4) an activation force, at a temporal resolution of 11 ms. An iterative algorithm solves a minimization problem containing four terms: a motion model relating the motion to the fully-sampled k-space data, a dynamical model describing the expected type of dynamics, a data consistency term describing the undersampling pattern, and finally a regularization term for the activation force. We acquired MRI data using a dynamic motion phantom programmed to move like an actively driven linear elastic system, from which all dynamic variables could be accurately reconstructed, regardless of the sampling pattern. The proposed method performed better than a two-step approach, where time-resolved images were first reconstructed from the undersampled data without any information about the motion, followed by a motion estimation step. △ Less

Submitted 11 October, 2023; originally announced October 2023.

Comments: 11 pages, 7 figures, 5 supplementary figures, 1 supplementary video. The video can be viewed by downloading the source file under "Other Formats"

On some isoperimetric inequalities for the Newtonian capacity

Authors: Michiel van den Berg

Abstract: Upper bounds are obtained for the Newtonian capacity of compact sets in $\R^d,\,d\ge 3$ in terms of the perimeter of the $r$-parallel neighbourhood of $K$. For compact, convex sets in $\R^d,\,d\ge 3$ with a $C^2$ boundary the Newtonian capacity is bounded from above by $(d-2)M(K)$, where $M(K)>0$ is the integral of the mean curvature over the boundary of $K$ with equality if $K$ is a ball. For com… ▽ More Upper bounds are obtained for the Newtonian capacity of compact sets in $\R^d,\,d\ge 3$ in terms of the perimeter of the $r$-parallel neighbourhood of $K$. For compact, convex sets in $\R^d,\,d\ge 3$ with a $C^2$ boundary the Newtonian capacity is bounded from above by $(d-2)M(K)$, where $M(K)>0$ is the integral of the mean curvature over the boundary of $K$ with equality if $K$ is a ball. For compact, convex sets in $\R^d,\,d\ge 3$ with non-empty interior the Newtonian capacity is bounded from above by $\frac{(d-2)P(K)^2}{d|K|}$ with equality if $K$ is a ball. Here $P(K)$ is the perimeter of $K$ and $|K|$ is its measure. A quantitative refinement of the latter inequality in terms of the Fraenkel asymmetry is also obtained. An upper bound is obtained for expected Newtonian capacity of the Wiener sausage in $\R^d,\,d\ge 5$ with radius $\varepsilon$ and time length $t$. △ Less

Submitted 7 May, 2024; v1 submitted 15 September, 2023; originally announced September 2023.

Comments: 15 pages

Synchrotron polarization signatures of surface waves in supermassive black hole jets

Authors: Jordy Davelaar, Bart Ripperda, Lorenzo Sironi, Alexander A. Philippov, Hector Olivares, Oliver Porth, Bram van den Berg, Thomas Bronzwaer, Koushik Chatterjee, Matthew Liska

Abstract: Supermassive black holes in active galactic nuclei (AGN) are known to launch relativistic jets, which are observed across the entire electromagnetic spectrum and are thought to be efficient particle accelerators. Their primary radiation mechanism for radio emission is polarized synchrotron emission produced by a population of non-thermal electrons. In this Letter, we present a global general relat… ▽ More Supermassive black holes in active galactic nuclei (AGN) are known to launch relativistic jets, which are observed across the entire electromagnetic spectrum and are thought to be efficient particle accelerators. Their primary radiation mechanism for radio emission is polarized synchrotron emission produced by a population of non-thermal electrons. In this Letter, we present a global general relativistic magnetohydrodynamical (GRMHD) simulation of a magnetically arrested disk (MAD). After the simulation reaches the MAD state, we show that waves are continuously launched from the vicinity of the black hole and propagate along the interface between the jet and the wind. At this interface, a steep gradient in velocity is present between the mildly relativistic wind and the highly relativistic jet. The interface is, therefore, a shear layer, and due to the shear, the waves generate roll-ups that alter the magnetic field configuration and the shear layer geometry. We then perform polarized radiation transfer calculations of our GRMHD simulation and find signatures of the waves in both total intensity and linear polarization, effectively lowering the fully resolved polarization fraction. The tell-tale polarization signatures of the waves could be observable by future Very Long Baseline Interferometric observations, e.g., by the next-generation Event Horizon Telescope. △ Less

Submitted 24 October, 2023; v1 submitted 14 September, 2023; originally announced September 2023.

Comments: 20 pages, 17 figures, accepted for publication in ApJL

Conservativity of Type Theory over Higher-order Arithmetic

Authors: Benno van den Berg, Daniël Otten

Abstract: We investigate how much type theory is able to prove about the natural numbers. A classical result in this area shows that dependent type theory without any universes is conservative over Heyting Arithmetic (HA). We build on this result by showing that type theories with one level of universes are conservative over Higher-order Heyting Arithmetic (HAH). Although this clearly depends on the specifi… ▽ More We investigate how much type theory is able to prove about the natural numbers. A classical result in this area shows that dependent type theory without any universes is conservative over Heyting Arithmetic (HA). We build on this result by showing that type theories with one level of universes are conservative over Higher-order Heyting Arithmetic (HAH). Although this clearly depends on the specific type theory, we show that the interpretation of logic also plays a major role. For proof-irrelevant interpretations, we will see that strong versions of type theory prove exactly the same higher-order arithmetical formulas as HAH. Conversely, proof-relevant interpretations prove strictly more second-order arithmetical formulas than HAH, however they still prove exactly the same first-order arithmetical formulas. Along the way, we investigate the different interpretations of logic in type theory, and to what extent dependent type theories can be seen as extensions of higher-order logic. We apply our results by proving De Jongh's theorem for type theory. △ Less

Submitted 29 August, 2023; originally announced August 2023.

Comments: 23 pages

MSC Class: 03B38; 03B16; 03F55; 03F50 ACM Class: F.4.1

Spin-wave spectral analysis in crescent-shaped ferromagnetic nanorods

Authors: Mateusz Gołębiewski, Hanna Reshetniak, Uladzislau Makartsou, Maciej Krawczyk, Arjen van den Berg, Sam Ladak, Anjan Barman

Abstract: The research on the properties of spin waves (SWs) in three-dimensional nanosystems is an innovative idea in the field of magnonics. Mastering and understanding the nature of magnetization dynamics and binding of SWs at surfaces, edges, and in-volume parts of three-dimensional magnetic systems enables the discovery of new phenomena and suggests new possibilities for their use in magnonic and spint… ▽ More The research on the properties of spin waves (SWs) in three-dimensional nanosystems is an innovative idea in the field of magnonics. Mastering and understanding the nature of magnetization dynamics and binding of SWs at surfaces, edges, and in-volume parts of three-dimensional magnetic systems enables the discovery of new phenomena and suggests new possibilities for their use in magnonic and spintronic devices. In this work, we use numerical methods to study the effect of geometry and external magnetic field manipulations on the localization and dynamics of SWs in crescent-shaped (CS) waveguides. It is shown that changing the magnetic field direction in these waveguides breaks the symmetry and affects the localization of eigenmodes with respect to the static demagnetizing field. This in turn has a direct effect on their frequency. Furthermore, CS structures were found to be characterized by significant saturation at certain field orientations, resulting in a cylindrical magnetization distribution. Thus, we present chirality-based nonreciprocal dispersion relations for high-frequency SWs, which can be controlled by the field direction (shape symmetry) and its amplitude (saturation). △ Less

Submitted 28 August, 2023; originally announced August 2023.

Journal ref: Phys. Rev. Applied 19, 6, 2200373 (2023)

Arrow algebras

Authors: Benno van den Berg, Marcus Briet

Abstract: In this paper we introduce arrow algebras, simple algebraic structures which induce elementary toposes through the tripos-to-topos construction. This includes localic toposes as well as various realizability toposes, in particular, those realizability toposes which are obtained from partial combinatory algebras. Since there are many examples of arrow algebras and arrow algebras have a number of cl… ▽ More In this paper we introduce arrow algebras, simple algebraic structures which induce elementary toposes through the tripos-to-topos construction. This includes localic toposes as well as various realizability toposes, in particular, those realizability toposes which are obtained from partial combinatory algebras. Since there are many examples of arrow algebras and arrow algebras have a number of closure properties, including a notion of subalgebra given by a nucleus, arrow algebras provide a flexible tool for constructing toposes; we illustrate this by providing some general tools for creating toposes for Kreisel's modified realizability. △ Less

Submitted 27 September, 2023; v1 submitted 27 August, 2023; originally announced August 2023.

Comments: Rewritten introduction

MSC Class: 03B40; 03G30; 18B25; 18F70

Real-time myocardial landmark tracking for MRI-guided cardiac radio-ablation using Gaussian Processes

Authors: Niek R. F. Huttinga, Osman Akdag, Martin F. Fast, Joost Verhoeff, Firdaus A. A. Mohamed Hoesein, Cornelis A. T. van den Berg, Alessandro Sbrizzi, Stefano Mandija

Abstract: The high speed of cardiorespiratory motion introduces a unique challenge for cardiac stereotactic radio-ablation (STAR) treatments with the MR-linac. Such treatments require tracking myocardial landmarks with a maximum latency of 100 ms, which includes the acquisition of the required data. The aim of this study is to present a new method that allows to track myocardial landmarks from few readouts… ▽ More The high speed of cardiorespiratory motion introduces a unique challenge for cardiac stereotactic radio-ablation (STAR) treatments with the MR-linac. Such treatments require tracking myocardial landmarks with a maximum latency of 100 ms, which includes the acquisition of the required data. The aim of this study is to present a new method that allows to track myocardial landmarks from few readouts of MRI data, thereby achieving a latency sufficient for STAR treatments. We present a tracking framework that requires only few readouts of k-space data as input, which can be acquired at least an order of magnitude faster than MR-images. Combined with the real-time tracking speed of a probabilistic machine learning framework called Gaussian Processes, this allows to track myocardial landmarks with a sufficiently low latency for cardiac STAR guidance, including both the acquisition of required data, and the tracking inference. The framework is demonstrated in 2D on a motion phantom, and in vivo on volunteers and a ventricular tachycardia (arrhythmia) patient. Moreover, the feasibility of an extension to 3D was demonstrated by in silico 3D experiments with a digital motion phantom. The framework was compared with template matching - a reference, image-based, method - and linear regression methods. Results indicate an order of magnitude lower total latency (<10 ms) for the proposed framework in comparison with alternative methods. The root-mean-square-distances and mean end-point-distance with the reference tracking method was less than 0.8 mm for all experiments, showing excellent (sub-voxel) agreement. The high accuracy in combination with a total latency of less than 10 ms - including data acquisition and processing - make the proposed method a suitable candidate for tracking during STAR treatments. △ Less

Submitted 19 June, 2023; originally announced June 2023.

A three-dimensional MR-STAT protocol for high-resolution multi-parametric quantitative MRI

Authors: Hongyan Liu, Oscar van der Heide, Edwin Versteeg, Martijn Froeling, Miha Fuderer, Fei Xu, Cornelis A. T. van den Berg, Alessandro Sbrizzi

Abstract: Magnetic Resonance Spin Tomography in Time-Domain (MR-STAT) is a multiparametric quantitative MR framework, which allows for simultaneously acquiring quantitative tissue parameters such as T1, T2 and proton density from one single short scan. A typical 2D MR-STAT acquisition uses a gradient-spoiled, gradient-echo sequence with a slowly varying RF flip-angle train and Cartesian readouts, and the qu… ▽ More Magnetic Resonance Spin Tomography in Time-Domain (MR-STAT) is a multiparametric quantitative MR framework, which allows for simultaneously acquiring quantitative tissue parameters such as T1, T2 and proton density from one single short scan. A typical 2D MR-STAT acquisition uses a gradient-spoiled, gradient-echo sequence with a slowly varying RF flip-angle train and Cartesian readouts, and the quantitative tissue maps are reconstructed by an iterative, model-based optimization algorithm. In this work, we design a 3D MR-STAT framework based on previous 2D work, in order to achieve better image SNR, higher though-plan resolution and better tissue characterization. Specifically, we design a 7-minute, high-resolution 3D MR-STAT sequence, and the corresponding two-step reconstruction algorithm for the large-scale dataset. To reduce the long acquisition time, Cartesian undersampling strategies such as SENSE are adopted in our transient-state quantitative framework. To reduce the computational burden, a data splitting scheme is designed for decoupling the 3D reconstruction problem into independent 2D reconstructions. The proposed 3D framework is validated by numerical simulations, phantom experiments and in-vivo experiments. High-quality knee quantitative maps with 0.8 x 0.8 x 1.5mm3 resolution and bilateral lower leg maps with 1.6mm isotropic resolution can be acquired using the proposed 7-minute acquisition sequence and the 3-minute-per-slice decoupled reconstruction algorithm. The proposed 3D MR-STAT framework could have wide clinical applications in the future. △ Less

Submitted 22 May, 2023; originally announced May 2023.

Journal ref: NMR Biomed. 2023. e5050

Generalizable synthetic MRI with physics-informed convolutional networks

Authors: Luuk Jacobs, Stefano Mandija, Hongyan Liu, Cornelis A. T. van den Berg, Alessandro Sbrizzi, Matteo Maspero

Abstract: In this study, we develop a physics-informed deep learning-based method to synthesize multiple brain magnetic resonance imaging (MRI) contrasts from a single five-minute acquisition and investigate its ability to generalize to arbitrary contrasts to accelerate neuroimaging protocols. A dataset of fifty-five subjects acquired with a standard MRI protocol and a five-minute transient-state sequence w… ▽ More In this study, we develop a physics-informed deep learning-based method to synthesize multiple brain magnetic resonance imaging (MRI) contrasts from a single five-minute acquisition and investigate its ability to generalize to arbitrary contrasts to accelerate neuroimaging protocols. A dataset of fifty-five subjects acquired with a standard MRI protocol and a five-minute transient-state sequence was used to develop a physics-informed deep learning-based method. The model, based on a generative adversarial network, maps data acquired from the five-minute scan to "effective" quantitative parameter maps, here named q*-maps, by using its generated PD, T1, and T2 values in a signal model to synthesize four standard contrasts (proton density-weighted, T1-weighted, T2-weighted, and T2-weighted fluid-attenuated inversion recovery), from which losses are computed. The q*-maps are compared to literature values and the synthetic contrasts are compared to an end-to-end deep learning-based method proposed by literature. The generalizability of the proposed method is investigated for five volunteers by synthesizing three non-standard contrasts unseen during training and comparing these to respective ground truth acquisitions via contrast-to-noise ratio and quantitative assessment. The physics-informed method was able to match the high-quality synthMRI of the end-to-end method for the four standard contrasts, with mean \pm standard deviation structural similarity metrics above 0.75 \pm 0.08 and peak signal-to-noise ratios above 22.4 \pm 1.9 and 22.6 \pm 2.1. Additionally, the physics-informed method provided retrospective contrast adjustment, with visually similar signal contrast and comparable contrast-to-noise ratios to the ground truth acquisitions for three sequences unused for model training, demonstrating its generalizability and potential application to accelerate neuroimaging protocols. △ Less

Submitted 21 May, 2023; originally announced May 2023.

Comments: 23 pages, 7 figures, 1 table. Presented at ISMRM 2022. Will be submitted to NMR in biomedicine

Journal ref: Med Phys. (2023)

Validated integration of semilinear parabolic PDEs

Authors: Jan Bouwe van den Berg, Maxime Breden, Ray Sheombarsing

Abstract: Integrating evolutionary partial differential equations (PDEs) is an essential ingredient for studying the dynamics of the solutions. Indeed, simulations are at the core of scientific computing, but their mathematical reliability is often difficult to quantify, especially when one is interested in the output of a given simulation, rather than in the asymptotic regime where the discretization param… ▽ More Integrating evolutionary partial differential equations (PDEs) is an essential ingredient for studying the dynamics of the solutions. Indeed, simulations are at the core of scientific computing, but their mathematical reliability is often difficult to quantify, especially when one is interested in the output of a given simulation, rather than in the asymptotic regime where the discretization parameter tends to zero. In this paper we present a computer-assisted proof methodology to perform rigorous time integration for scalar semilinear parabolic PDEs with periodic boundary conditions. We formulate an equivalent zero-finding problem based on a variations of constants formula in Fourier space. Using Chebyshev interpolation and domain decomposition, we then finish the proof with a Newton--Kantorovich type argument. The final output of this procedure is a proof of existence of an orbit, together with guaranteed error bounds between this orbit and a numerically computed approximation. We illustrate the versatility of the approach with results for the Fisher equation, the Swift--Hohenberg equation, the Ohta--Kawasaki equation and the Kuramoto--Sivashinsky equation. We expect that this rigorous integrator can form the basis for studying boundary value problems for connecting orbits in partial differential equations. △ Less

Submitted 27 May, 2024; v1 submitted 14 May, 2023; originally announced May 2023.

Comments: Revised accepted version

Automatic Differentiation in Prolog

Authors: Tom Schrijvers, Birthe van den Berg, Fabrizio Riguzzi

Abstract: Automatic differentiation (AD) is a range of algorithms to compute the numeric value of a function's (partial) derivative, where the function is typically given as a computer program or abstract syntax tree. AD has become immensely popular as part of many learning algorithms, notably for neural networks. This paper uses Prolog to systematically derive gradient-based forward- and reverse-mode AD va… ▽ More Automatic differentiation (AD) is a range of algorithms to compute the numeric value of a function's (partial) derivative, where the function is typically given as a computer program or abstract syntax tree. AD has become immensely popular as part of many learning algorithms, notably for neural networks. This paper uses Prolog to systematically derive gradient-based forward- and reverse-mode AD variants from a simple executable specification: evaluation of the symbolic derivative. Along the way we demonstrate that several Prolog features (DCGs, co-routines) contribute to the succinct formulation of the algorithm. We also discuss two applications in probabilistic programming that are enabled by our Prolog algorithms. The first is parameter learning for the Sum-Product Loop Language and the second consists of both parameter learning and variational inference for probabilistic logic programming. △ Less

Submitted 13 May, 2023; originally announced May 2023.

Comments: accepted for publication in the issues of Theory and Practice of Logic Programming dedicated to ICLP 2023

On the onset delays of solar energetic electrons and protons: Evidence for a common accelerator

Authors: R. D. Strauss, N. Dresing, I. G. Richardson, J. P. van den Berg, P. J. Steyn

Abstract: The processes responsible for the acceleration of solar energetic particles (SEPs) are still not well understood, including whether SEP electrons and protons are accelerated by common or separate processes. Using a numerical particle transport model that includes both pitch-angle and perpendicular spatial diffusion, we simulate, amongst other quantities, the onset delay for MeV electrons and proto… ▽ More The processes responsible for the acceleration of solar energetic particles (SEPs) are still not well understood, including whether SEP electrons and protons are accelerated by common or separate processes. Using a numerical particle transport model that includes both pitch-angle and perpendicular spatial diffusion, we simulate, amongst other quantities, the onset delay for MeV electrons and protons and compare the results to observations of SEPs from widely-separated spacecraft. Such observations have previously been interpreted, in a simple scenario assuming no perpendicular diffusion, as evidence for different electron and proton sources. We show that, by assuming a common particle source together with perpendicular diffusion, we are able to simultaneously reproduce the onset delays for both electrons and protons. We argue that this points towards a common accelerator for these particles. Moreover, a relatively broad particle source is required in the model to correctly describe the observations. This is suggestive of diffusive shock acceleration occurring at large shock structures playing a significant role in the acceleration of these SEPs. △ Less

Submitted 9 May, 2023; originally announced May 2023.

Comments: Accepted to ApJ

A Calculus for Scoped Effects & Handlers

Authors: Roger Bosman, Birthe van den Berg, Wenhao Tang, Tom Schrijvers

Abstract: Algebraic effects & handlers have become a standard approach for side-effects in functional programming. Their modular composition with other effects and clean separation of syntax and semantics make them attractive to a wide audience. However, not all effects can be classified as algebraic; some need a more sophisticated handling. In particular, effects that have or create a delimited scope need… ▽ More Algebraic effects & handlers have become a standard approach for side-effects in functional programming. Their modular composition with other effects and clean separation of syntax and semantics make them attractive to a wide audience. However, not all effects can be classified as algebraic; some need a more sophisticated handling. In particular, effects that have or create a delimited scope need special care, as their continuation consists of two parts-in and out of the scope-and their modular composition introduces additional complexity. These effects are called scoped and have gained attention by their growing applicability and adoption in popular libraries. While calculi have been designed with algebraic effects & handlers built in to facilitate their use, a calculus that supports scoped effects & handlers in a similar manner does not yet exist. This work fills this gap: we present $λ_{\mathit{sc}}$, a calculus with native support for both algebraic and scoped effects & handlers. It addresses the need for polymorphic handlers and explicit clauses for forwarding unknown scoped operations to other handlers. Our calculus is based on Eff, an existing calculus for algebraic effects, extended with Koka-style row polymorphism, and consists of a formal grammar, operational semantics, a (type-safe) type-and-effect system and type inference. We demonstrate $λ_{\mathit{sc}}$ on a range of examples. △ Less

Submitted 5 March, 2024; v1 submitted 19 April, 2023; originally announced April 2023.

SynthRAD2023 Grand Challenge dataset: generating synthetic CT for radiotherapy

Authors: Adrian Thummerer, Erik van der Bijl, Arthur Jr Galapon, Joost JC Verhoeff, Johannes A Langendijk, Stefan Both, Cornelis, AT van den Berg, Matteo Maspero

Abstract: Purpose: Medical imaging has become increasingly important in diagnosing and treating oncological patients, particularly in radiotherapy. Recent advances in synthetic computed tomography (sCT) generation have increased interest in public challenges to provide data and evaluation metrics for comparing different approaches openly. This paper describes a dataset of brain and pelvis computed tomograph… ▽ More Purpose: Medical imaging has become increasingly important in diagnosing and treating oncological patients, particularly in radiotherapy. Recent advances in synthetic computed tomography (sCT) generation have increased interest in public challenges to provide data and evaluation metrics for comparing different approaches openly. This paper describes a dataset of brain and pelvis computed tomography (CT) images with rigidly registered CBCT and MRI images to facilitate the development and evaluation of sCT generation for radiotherapy planning. Acquisition and validation methods: The dataset consists of CT, CBCT, and MRI of 540 brains and 540 pelvic radiotherapy patients from three Dutch university medical centers. Subjects' ages ranged from 3 to 93 years, with a mean age of 60. Various scanner models and acquisition settings were used across patients from the three data-providing centers. Details are available in CSV files provided with the datasets. Data format and usage notes: The data is available on Zenodo (https://doi.org/10.5281/zenodo.7260705) under the SynthRAD2023 collection. The images for each subject are available in nifti format. Potential applications: This dataset will enable the evaluation and development of image synthesis algorithms for radiotherapy purposes on a realistic multi-center dataset with varying acquisition protocols. Synthetic CT generation has numerous applications in radiation therapy, including diagnosis, treatment planning, treatment monitoring, and surgical planning. △ Less

Submitted 28 March, 2023; originally announced March 2023.

Comments: 15 pages, 4 figures, 9 tables, pre-print submitted to Medical Physics - dataset. The training dataset is available on Zenodo at https://doi.org/10.5281/zenodo.7260705 from April, 1st 2023

Exploring contrast generalisation in deep learning-based brain MRI-to-CT synthesis

Authors: Lotte Nijskens, Cornelis, AT van den Berg, Joost JC Verhoeff, Matteo Maspero

Abstract: Background: Synthetic computed tomography (sCT) has been proposed and increasingly clinically adopted to enable magnetic resonance imaging (MRI)-based radiotherapy. Deep learning (DL) has recently demonstrated the ability to generate accurate sCT from fixed MRI acquisitions. However, MRI protocols may change over time or differ between centres resulting in low-quality sCT due to poor model general… ▽ More Background: Synthetic computed tomography (sCT) has been proposed and increasingly clinically adopted to enable magnetic resonance imaging (MRI)-based radiotherapy. Deep learning (DL) has recently demonstrated the ability to generate accurate sCT from fixed MRI acquisitions. However, MRI protocols may change over time or differ between centres resulting in low-quality sCT due to poor model generalisation. Purpose: investigating domain randomisation (DR) to increase the generalisation of a DL model for brain sCT generation. Methods: CT and corresponding T1-weighted MRI with/without contrast, T2-weighted, and FLAIR MRI from 95 patients undergoing RT were collected, considering FLAIR the unseen sequence where to investigate generalisation. A ``Baseline'' generative adversarial network was trained with/without the FLAIR sequence to test how a model performs without DR. Image similarity and accuracy of sCT-based dose plans were assessed against CT to select the best-performing DR approach against the Baseline. Results: The Baseline model had the poorest performance on FLAIR, with mean absolute error (MAE)=106$\pm$20.7 HU (mean$\pmσ$). Performance on FLAIR significantly improved for the DR model with MAE=99.0$\pm$14.9 HU, but still inferior to the performance of the Baseline+FLAIR model (MAE=72.6$\pm$10.1 HU). Similarly, an improvement in $γ$-pass rate was obtained for DR vs Baseline. Conclusions: DR improved image similarity and dose accuracy on the unseen sequence compared to training only on acquired MRI. DR makes the model more robust, reducing the need for re-training when applying a model on sequences unseen and unavailable for retraining. △ Less

Submitted 17 March, 2023; originally announced March 2023.

Comments: Preprint submitted to Physica Medica on 2023-02-16 for review. Also published in Zenodo at https://doi.org/10.5281/zenodo.7742642

Gaussian elimination for flexible systems of linear inclusions

Authors: Nam Van Tran, Imme van den Berg

Abstract: Flexible systems are linear systems of inclusions in which the elements of the coefficient matrix are external numbers in the sense of nonstandard analysis. External numbers represent real numbers with small, individual error terms. Using Gaussian elimination, a flexible system can be put into a row-echelon form with increasing error terms at the right-hand side. Then parameters are assigned to th… ▽ More Flexible systems are linear systems of inclusions in which the elements of the coefficient matrix are external numbers in the sense of nonstandard analysis. External numbers represent real numbers with small, individual error terms. Using Gaussian elimination, a flexible system can be put into a row-echelon form with increasing error terms at the right-hand side. Then parameters are assigned to the error terms and the resulting system is solved by common methods of linear algebra. The solution set may have indeterminacy not only in terms of linear spaces, but also of modules. We determine maximal robustness for flexible systems. △ Less

Submitted 12 December, 2022; originally announced February 2023.

Comments: 37 pages

MSC Class: 03H05; 15A03; 15A09; 15B33; 65F99

Investigating Mechanisms of State Localization in Highly-Ionized Dense Plasmas

Authors: Thomas Gawne, Thomas Campbell, Alessandro Forte, Patrick Hollebon, Gabriel Perez-Callejo, Oliver Humphries, Oliver Karnbach, Muhammad F. Kasim, Thomas R. Preston, Hae Ja Lee, Alan Miscampbell, Quincy Y. van den Berg, Bob Nagler, Shenyuan Ren, Ryan B. Royle, Justin S. Wark, Sam M. Vinko

Abstract: We present the first experimental observation of K$_β$ emission from highly charged Mg ions at solid density, driven by intense x-rays from a free electron laser. The presence of K$_β$ emission indicates the $n=3$ atomic shell is relocalized for high charge states, providing an upper constraint on the depression of the ionization potential. We explore the process of state relocalization in dense p… ▽ More We present the first experimental observation of K$_β$ emission from highly charged Mg ions at solid density, driven by intense x-rays from a free electron laser. The presence of K$_β$ emission indicates the $n=3$ atomic shell is relocalized for high charge states, providing an upper constraint on the depression of the ionization potential. We explore the process of state relocalization in dense plasmas from first principles using finite-temperature density functional theory alongside a wavefunction localization metric, and find excellent agreement with experimental results. △ Less

Submitted 14 August, 2023; v1 submitted 8 February, 2023; originally announced February 2023.

Comments: 22 pages, 13 figures

A Framework for Higher-Order Effects & Handlers

Authors: Birthe van den Berg, Tom Schrijvers

Abstract: Algebraic effects & handlers are a modular approach for modeling side-effects in functional programming. Their syntax is defined in terms of a signature of effectful operations, encoded as a functor, that are plugged into the free monad; their denotational semantics is defined by fold-style handlers that only interpret their part of the syntax and forward the rest. However, not all effects are alg… ▽ More Algebraic effects & handlers are a modular approach for modeling side-effects in functional programming. Their syntax is defined in terms of a signature of effectful operations, encoded as a functor, that are plugged into the free monad; their denotational semantics is defined by fold-style handlers that only interpret their part of the syntax and forward the rest. However, not all effects are algebraic: some need to access an internal computation. For example, scoped effects distinguish between a computation in scope and out of scope; parallel effects parallellize over a computation, latent effects defer a computation. Separate definitions have been proposed for these higher-order effects and their corresponding handlers, often leading to expedient and complex monad definitions. In this work we propose a generic framework for higher-order effects, generalizing algebraic effects & handlers: a generic free monad with higher-order effect signatures and a corresponding interpreter. Specializing this higher-order syntax leads to various definitions of previously defined (scoped, parallel, latent) and novel (writer, bracketing) effects. Furthermore, we formally show our framework theoretically correct, also putting different effect instances on formal footing; a significant contribution for parallel, latent, writer and bracketing effects. △ Less

Submitted 2 February, 2023; originally announced February 2023.

Two for One: Diffusion Models and Force Fields for Coarse-Grained Molecular Dynamics

Authors: Marloes Arts, Victor Garcia Satorras, Chin-Wei Huang, Daniel Zuegner, Marco Federici, Cecilia Clementi, Frank Noé, Robert Pinsler, Rianne van den Berg

Abstract: Coarse-grained (CG) molecular dynamics enables the study of biological processes at temporal and spatial scales that would be intractable at an atomistic resolution. However, accurately learning a CG force field remains a challenge. In this work, we leverage connections between score-based generative models, force fields and molecular dynamics to learn a CG force field without requiring any force… ▽ More Coarse-grained (CG) molecular dynamics enables the study of biological processes at temporal and spatial scales that would be intractable at an atomistic resolution. However, accurately learning a CG force field remains a challenge. In this work, we leverage connections between score-based generative models, force fields and molecular dynamics to learn a CG force field without requiring any force inputs during training. Specifically, we train a diffusion generative model on protein structures from molecular dynamics simulations, and we show that its score function approximates a force field that can directly be used to simulate CG molecular dynamics. While having a vastly simplified training setup compared to previous work, we demonstrate that our approach leads to improved performance across several small- to medium-sized protein simulations, reproducing the CG equilibrium distribution, and preserving dynamics of all-atom simulations such as protein folding events. △ Less

Submitted 22 September, 2023; v1 submitted 1 February, 2023; originally announced February 2023.

Early life exposure to measles and later-life outcomes: Evidence from the introduction of a vaccine

Authors: Gerard J. van den Berg, Stephanie von Hinke, Nicolai Vitt

Abstract: Until the mid 1960s, the UK experienced regular measles epidemics, with the vast majority of children being infected in early childhood. The introduction of a measles vaccine substantially reduced its incidence. The first part of this paper examines the long-term human capital and health effects of this change in the early childhood disease environment. The second part investigates interactions be… ▽ More Until the mid 1960s, the UK experienced regular measles epidemics, with the vast majority of children being infected in early childhood. The introduction of a measles vaccine substantially reduced its incidence. The first part of this paper examines the long-term human capital and health effects of this change in the early childhood disease environment. The second part investigates interactions between the vaccination campaign and individuals' endowments as captured using molecular genetic data, shedding light on complementarities between public health investments and individual endowments. We use two identification approaches, based on the nationwide introduction of the vaccine in 1968 and local vaccination trials in 1966. Our results show that exposure to the vaccination in early childhood positively affects adult height, but only among those with high genetic endowments for height. We find no effects on years of education; neither a direct effect, nor evidence of complementarities. △ Less

Submitted 25 January, 2023; originally announced January 2023.

Prenatal Sugar Consumption and Late-Life Human Capital and Health: Analyses Based on Postwar Rationing and Polygenic Scores

Authors: Gerard J. van den Berg, Stephanie von Hinke, R. Adele H. Wang

Abstract: Maternal sugar consumption in utero may have a variety of effects on offspring. We exploit the abolishment of the rationing of sweet confectionery in the UK on April 24, 1949, and its subsequent reintroduction some months later, in an era of otherwise uninterrupted rationing of confectionery (1942-1953), sugar (1940-1953) and many other foods, and we consider effects on late-life cardiovascular di… ▽ More Maternal sugar consumption in utero may have a variety of effects on offspring. We exploit the abolishment of the rationing of sweet confectionery in the UK on April 24, 1949, and its subsequent reintroduction some months later, in an era of otherwise uninterrupted rationing of confectionery (1942-1953), sugar (1940-1953) and many other foods, and we consider effects on late-life cardiovascular disease, BMI, height, type-2 diabetes and the intake of sugar, fat and carbohydrates, as well as cognitive outcomes and birth weight. We use individual-level data from the UK Biobank for cohorts born between April 1947-May 1952. We also explore whether one's genetic "predisposition" to the outcome can moderate the effects of prenatal sugar exposure. We find that prenatal exposure to derationing increases education and reduces BMI and sugar consumption at higher ages, in line with the "developmental origins" explanatory framework, and that the sugar effects are stronger for those who are genetically "predisposed" to sugar consumption. △ Less

Submitted 24 January, 2023; originally announced January 2023.

Forward- or Reverse-Mode Automatic Differentiation: What's the Difference?

Authors: Birthe van den Berg, Tom Schrijvers, James McKinna, Alexander Vandenbroucke

Abstract: Automatic differentiation (AD) has been a topic of interest for researchers in many disciplines, with increased popularity since its application to machine learning and neural networks. Although many researchers appreciate and know how to apply AD, it remains a challenge to truly understand the underlying processes. From an algebraic point of view, however, AD appears surprisingly natural: it orig… ▽ More Automatic differentiation (AD) has been a topic of interest for researchers in many disciplines, with increased popularity since its application to machine learning and neural networks. Although many researchers appreciate and know how to apply AD, it remains a challenge to truly understand the underlying processes. From an algebraic point of view, however, AD appears surprisingly natural: it originates from the differentiation laws. In this work we use Algebra of Programming techniques to reason about different AD variants, leveraging Haskell to illustrate our observations. Our findings stem from three fundamental algebraic abstractions: (1) the notion of module over a semiring, (2) Nagata's construction of the 'idealization of a module', and (3) Kronecker's delta function, that together allow us to write a single-line abstract definition of AD. From this single-line definition, and by instantiating our algebraic structures in various ways, we derive different AD variants, that have the same extensional behaviour, but different intensional properties, mainly in terms of (asymptotic) computational complexity. We show the different variants equivalent by means of Kronecker isomorphisms, a further elaboration of our Haskell infrastructure which guarantees correctness by construction. With this framework in place, this paper seeks to make AD variants more comprehensible, taking an algebraic perspective on the matter. △ Less

Submitted 9 August, 2023; v1 submitted 21 December, 2022; originally announced December 2022.

Single-shot error mitigation by coherent Pauli checks

Authors: Ewout van den Berg, Sergey Bravyi, Jay M. Gambetta, Petar Jurcevic, Dmitri Maslov, Kristan Temme

Abstract: Generating samples from the output distribution of a quantum circuit is a ubiquitous task used as a building block of many quantum algorithms. Here we show how to accomplish this task on a noisy quantum processor lacking full-blown error correction for a special class of quantum circuits dominated by Clifford gates. Our approach is based on Coherent Pauli Checks (CPCs) that detect errors in a Clif… ▽ More Generating samples from the output distribution of a quantum circuit is a ubiquitous task used as a building block of many quantum algorithms. Here we show how to accomplish this task on a noisy quantum processor lacking full-blown error correction for a special class of quantum circuits dominated by Clifford gates. Our approach is based on Coherent Pauli Checks (CPCs) that detect errors in a Clifford circuit by verifying commutation rules between random Pauli-type check operators and the considered circuit. Our main contributions are as follows. First, we derive a simple formula for the probability that a Clifford circuit protected by CPCs contains a logical error. In the limit of a large number of checks, the logical error probability is shown to approach the value ${\approx}7εn/5$, where $n$ is the number of qubits and $ε$ is the depolarizing error rate. Our formula agrees nearly perfectly with the numerical simulation results. Second, we show that CPCs are well-suited for quantum processors with a limited qubit connectivity. For example, the difference between all-to-all and linear qubit connectivity is only a 3X increase in the number of CNOT gates required to implement CPCs. Third, we describe simplified one-sided CPCs which are well-suited for mitigating measurement errors in the single-shot settings. Finally, we report an experimental demonstration of CPCs with up to 10 logical qubits and more than 100 logical CNOT gates. Our experimental results show that CPCs provide a marked improvement in the logical error probability for the considered task of sampling the output distribution of quantum circuits. △ Less

Submitted 7 December, 2022; originally announced December 2022.

Comments: 30 pages, 20 figures

Journal ref: Phys. Rev. Research 5, 033193 (2023)

Constructive proofs for localized radial solutions of semilinear elliptic systems on $\mathbb{R}^d$

Authors: Jan Bouwe van den Berg, Olivier Hénot, Jean-Philippe Lessard

Abstract: Ground state solutions of elliptic problems have been analyzed extensively in the theory of partial differential equations, as they represent fundamental spatial patterns in many model equations. While the results for scalar equations, as well as certain specific classes of elliptic systems, are comprehensive, much less is known about these localized solutions in generic systems of nonlinear ellip… ▽ More Ground state solutions of elliptic problems have been analyzed extensively in the theory of partial differential equations, as they represent fundamental spatial patterns in many model equations. While the results for scalar equations, as well as certain specific classes of elliptic systems, are comprehensive, much less is known about these localized solutions in generic systems of nonlinear elliptic equations. In this paper we present a general method to prove constructively the existence of localized radially symmetric solutions of elliptic systems on $\mathbb{R}^d$. Such solutions are essentially described by systems of non-autonomous ordinary differential equations. We study these systems using dynamical systems theory and computer-assisted proof techniques, combining a suitably chosen Lyapunov-Perron operator with a Newton-Kantorovich type theorem. We demonstrate the power of this methodology by proving specific localized radial solutions of the cubic Klein-Gordon equation on $\mathbb{R}^3$, the Swift-Hohenberg equation on $\mathbb{R}^2$, and a three-component FitzHugh-Nagumo system on $\mathbb{R}^2$. These results illustrate that ground state solutions in a wide range of elliptic systems are tractable through constructive proofs. △ Less

Submitted 16 October, 2023; v1 submitted 29 November, 2022; originally announced November 2022.

Accelerated respiratory-resolved 4D-MRI with separable spatio-temporal neural networks

Authors: Maarten Terpstra, Matteo Maspero, Joost Verhoeff, Cornelis van den Berg

Abstract: Background: Respiratory-resolved four-dimensional magnetic resonance imaging (4D-MRI) provides essential motion information for accurate radiation treatments of mobile tumors. However, obtaining high-quality 4D-MRI suffers from long acquisition and reconstruction times. Purpose: To develop a deep learning architecture to quickly acquire and reconstruct high-quality 4D-MRI, enabling accurate moti… ▽ More Background: Respiratory-resolved four-dimensional magnetic resonance imaging (4D-MRI) provides essential motion information for accurate radiation treatments of mobile tumors. However, obtaining high-quality 4D-MRI suffers from long acquisition and reconstruction times. Purpose: To develop a deep learning architecture to quickly acquire and reconstruct high-quality 4D-MRI, enabling accurate motion quantification for MRI-guided radiotherapy. Methods: A small convolutional neural network called MODEST is proposed to reconstruct 4D-MRI by performing a spatial and temporal decomposition, omitting the need for 4D convolutions to use all the spatio-temporal information present in 4D-MRI. This network is trained on undersampled 4D-MRI after respiratory binning to reconstruct high-quality 4D-MRI obtained by compressed sensing reconstruction. The network is trained, validated, and tested on 4D-MRI of 28 lung cancer patients acquired with a T1-weighted golden-angle radial stack-of-stars sequence. The 4D-MRI of 18, 5, and 5 patients were used for training, validation, and testing. Network performances are evaluated on image quality measured by the structural similarity index (SSIM) and motion consistency by comparing the position of the lung-liver interface on undersampled 4D-MRI before and after respiratory binning. The network is compared to conventional architectures such as a U-Net, which has 30 times more trainable parameters. Results: MODEST can reconstruct high-quality 4D-MRI with higher image quality than a U-Net, despite a thirty-fold reduction in trainable parameters. High-quality 4D-MRI can be obtained using MODEST in approximately 2.5 minutes, including acquisition, processing, and reconstruction. Conclusion: High-quality accelerated 4D-MRI can be obtained using MODEST, which is particularly interesting for MRI-guided radiotherapy. △ Less

Submitted 3 August, 2023; v1 submitted 10 November, 2022; originally announced November 2022.

Comments: Code available at https://gitlab.com/computational-imaging-lab/modest

Journal ref: Med Phys. 2023; 1-12

Exploring the phases of 3D artificial spin ice: From Coulomb phase to magnetic monopole crystal

Authors: M. Saccone, A. Van den Berg, E. Harding, S. Singh, S. R. Giblin, F. Flicker, S. Ladak

Abstract: Artificial spin-ices consist of lithographic arrays of single-domain magnetic nanowires organised into frustrated lattices. These geometries are usually two-dimensional, allowing a direct exploration of physics associated with frustration, topology and emergence. Recently, three-dimensional geometries have been realised, in which transport of emergent monopoles can be directly visualised upon the… ▽ More Artificial spin-ices consist of lithographic arrays of single-domain magnetic nanowires organised into frustrated lattices. These geometries are usually two-dimensional, allowing a direct exploration of physics associated with frustration, topology and emergence. Recently, three-dimensional geometries have been realised, in which transport of emergent monopoles can be directly visualised upon the surface. Here we carry out an exploration of the three-dimensional artificial spin-ice phase diagram, whereby dipoles are placed within a diamond-bond lattice geometry. We find a rich phase diagram, consisting of a double-charged monopole crystal, a single-charged monopole crystal and conventional spin-ice with pinch points associated with a Coulomb phase. In our experimental demagnetised systems, broken symmetry forces formation of ferromagnetic stripes upon the surface, a configuration that forbids the formation of the lower energy double-charged monopole crystal. Instead, we observe crystallites of single magnetic charge, superimposed upon an ice background. The crystallites are found to form due to the intricate distribution of magnetic charge around a three-dimensional nanostructured vertex, which locally favours monopole formation. Our work suggests that engineered surface energetics can be used to tune the ground state of experimental three-dimensional ASI systems. △ Less

Submitted 8 November, 2022; originally announced November 2022.

Journal ref: Communications Physics volume 6, Article number: 217 (2023)

Optimal Control for Wind Turbine Wake Mixing on Floating Platforms

Authors: Maarten J. van den Broek, Daniel van den Berg, Benjamin Sanderse, Jan-Willem van Wingerden

Abstract: Dynamic induction control is a wind farm flow control strategy that utilises wind turbine thrust variations to accelerate breakdown of the aerodynamic wake and improve downstream turbine performance. However, when floating wind turbines are considered, additional dynamics and challenges appear that make optimal control difficult. In this work, we propose an adjoint optimisation framework for non-l… ▽ More Dynamic induction control is a wind farm flow control strategy that utilises wind turbine thrust variations to accelerate breakdown of the aerodynamic wake and improve downstream turbine performance. However, when floating wind turbines are considered, additional dynamics and challenges appear that make optimal control difficult. In this work, we propose an adjoint optimisation framework for non-linear economic model-predictive control, which utilises a novel coupling of an existing aerodynamic wake model to floating platform hydrodynamics. Analysis of the frequency response for the coupled model shows that it is possible to achieve wind turbine thrust variations without inducing large motion of the rotor. Using economic model-predictive control, we find dynamic induction results that lead to an improvement of 7% over static induction control, where the dynamic controller stimulates wake breakdown with only small variations in rotor displacement. This novel model formulation provides a starting point for the adaptation of dynamic wind farm flow control strategies for floating wind turbines. △ Less

Submitted 27 March, 2023; v1 submitted 31 October, 2022; originally announced October 2022.

Comments: 6 pages, 8 figures, accepted for publication for IFAC World Congress 2023

An OSSS-type inequality for uniformly drawn subsets of fixed size

Authors: Jacob van den Berg, Henk Don

Abstract: The OSSS inequality [O'Donnell, Saks, Schramm and Servedio, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05), Pittsburgh (2005)] gives an upper bound for the variance of a function f of independent 0-1 valued random variables, in terms of the influences of these random variables and the computational complexity of a (randomised) algorithm for determining the value of f. Dumi… ▽ More The OSSS inequality [O'Donnell, Saks, Schramm and Servedio, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05), Pittsburgh (2005)] gives an upper bound for the variance of a function f of independent 0-1 valued random variables, in terms of the influences of these random variables and the computational complexity of a (randomised) algorithm for determining the value of f. Duminil-Copin, Raoufi and Tassion [Annals of Mathematics 189, 75-99 (2019)] obtained a generalization to monotonic measures and used it to prove new results for Potts models and random-cluster models. Their generalization of the OSSS inequality raises the question if there are still other measures for which a version of that inequality holds. We derive a version of the OSSS inequality for a family of measures that are far from monotonic, namely the k-out-of-n measures (these measures correspond with drawing k elements from a set of size n uniformly). We illustrate the inequality by studying the event that there is an occupied horizontal crossing of an R times R box on the triangular lattice in the site percolation model where exactly half of the vertices in the box are occupied. △ Less

Submitted 18 June, 2024; v1 submitted 28 October, 2022; originally announced October 2022.

Comments: 25 pages. Compared with the previous version: Improvement of factor log n in the main theorem (Theorem 1.1). Proof of that theorem has been substantially changed. Additional author (Henk Don)

MSC Class: 60K35 (Primary) 60C05 (Secondary)

A 2D forest fire process beyond the critical time

Authors: Jacob van den Berg, Pierre Nolin

Abstract: We study forest fire processes in two dimensions. On a given planar lattice, vertices independently switch from vacant to occupied at rate $1$ (initially they are all vacant), and any connected component "is burnt" (its vertices become instantaneously vacant) as soon as its cardinality crosses a (typically large) threshold $N$, the parameter of the model. Our analysis provides a detailed descrip… ▽ More We study forest fire processes in two dimensions. On a given planar lattice, vertices independently switch from vacant to occupied at rate $1$ (initially they are all vacant), and any connected component "is burnt" (its vertices become instantaneously vacant) as soon as its cardinality crosses a (typically large) threshold $N$, the parameter of the model. Our analysis provides a detailed description, as $N \to \infty$, of the process near and beyond the critical time $t_c$ (at which an infinite cluster would arise in the absence of fires). In particular we prove a somewhat counterintuitive result: there exists $δ> 0$ such that with high probability, the origin does not burn before time $t_c + δ$. This provides a negative answer to Open Problem 4.1 of van den Berg and Brouwer [Comm. Math. Phys., 2006]. Informally speaking, the result can be explained in terms of the emergence of fire lanes, whose total density is negligible (as $N \to \infty$), but which nevertheless are sufficiently robust with respect to recoveries. We expect that such a behavior also holds for the classical Drossel-Schwabl model. A large part of this paper is devoted to analyzing recoveries during the interval $[t_c, t_c + δ]$. These recoveries do have a "microscopic" effect, but it turns out that their combined influence on macroscopic scales (and in fact on relevant "mesoscopic" scales) vanishes as $N \to \infty$. In order to prove this, we use key ideas of Kiss, Manolescu and Sidoravicius [Ann. Probab., 2015], introducing a suitable induction argument to extend and strengthen their results. We then use it to prove that a deconcentration result in our earlier joint work with Kiss on volume-frozen percolation also holds for the forest fire process. As we explain, significant additional difficulties arise here, since recoveries destroy the nice spatial Markov property of frozen percolation. △ Less

Submitted 11 October, 2022; originally announced October 2022.

Comments: 53 pages, 7 figures

Protein structure generation via folding diffusion

Authors: Kevin E. Wu, Kevin K. Yang, Rianne van den Berg, James Y. Zou, Alex X. Lu, Ava P. Amini

Abstract: The ability to computationally generate novel yet physically foldable protein structures could lead to new biological discoveries and new treatments targeting yet incurable diseases. Despite recent advances in protein structure prediction, directly generating diverse, novel protein structures from neural networks remains difficult. In this work, we present a new diffusion-based generative model th… ▽ More The ability to computationally generate novel yet physically foldable protein structures could lead to new biological discoveries and new treatments targeting yet incurable diseases. Despite recent advances in protein structure prediction, directly generating diverse, novel protein structures from neural networks remains difficult. In this work, we present a new diffusion-based generative model that designs protein backbone structures via a procedure that mirrors the native folding process. We describe protein backbone structure as a series of consecutive angles capturing the relative orientation of the constituent amino acid residues, and generate new structures by denoising from a random, unfolded state towards a stable folded structure. Not only does this mirror how proteins biologically twist into energetically favorable conformations, the inherent shift and rotational invariance of this representation crucially alleviates the need for complex equivariant networks. We train a denoising diffusion probabilistic model with a simple transformer backbone and demonstrate that our resulting model unconditionally generates highly realistic protein structures with complexity and structural patterns akin to those of naturally-occurring proteins. As a useful resource, we release the first open-source codebase and trained models for protein structure diffusion. △ Less

Submitted 23 November, 2022; v1 submitted 30 September, 2022; originally announced September 2022.

ACM Class: I.2.0; J.3

Clifford Neural Layers for PDE Modeling

Authors: Johannes Brandstetter, Rianne van den Berg, Max Welling, Jayesh K. Gupta

Abstract: Partial differential equations (PDEs) see widespread use in sciences and engineering to describe simulation of physical processes as scalar and vector fields interacting and coevolving over time. Due to the computationally expensive nature of their standard solution methods, neural PDE surrogates have become an active research topic to accelerate these simulations. However, current methods do not… ▽ More Partial differential equations (PDEs) see widespread use in sciences and engineering to describe simulation of physical processes as scalar and vector fields interacting and coevolving over time. Due to the computationally expensive nature of their standard solution methods, neural PDE surrogates have become an active research topic to accelerate these simulations. However, current methods do not explicitly take into account the relationship between different fields and their internal components, which are often correlated. Viewing the time evolution of such correlated fields through the lens of multivector fields allows us to overcome these limitations. Multivector fields consist of scalar, vector, as well as higher-order components, such as bivectors and trivectors. Their algebraic properties, such as multiplication, addition and other arithmetic operations can be described by Clifford algebras. To our knowledge, this paper presents the first usage of such multivector representations together with Clifford convolutions and Clifford Fourier transforms in the context of deep learning. The resulting Clifford neural layers are universally applicable and will find direct use in the areas of fluid dynamics, weather forecasting, and the modeling of physical systems in general. We empirically evaluate the benefit of Clifford neural layers by replacing convolution and Fourier operations in common neural PDE surrogates by their Clifford counterparts on 2D Navier-Stokes and weather modeling tasks, as well as 3D Maxwell equations. For similar parameter count, Clifford neural layers consistently improve generalization capabilities of the tested neural PDE surrogates. Source code for our PyTorch implementation is available at https://microsoft.github.io/cliffordlayers/. △ Less

Submitted 2 March, 2023; v1 submitted 8 September, 2022; originally announced September 2022.

Comments: Accepted at ICLR-2023

Geodesic Tracking via New Data-driven Connections of Cartan Type for Vascular Tree Tracking

Authors: Nicky van den Berg, Bart Smets, Gautam Pai, Jean-Marie Mirebeau, Remco Duits

Abstract: We introduce a data-driven version of the plus Cartan connection on the homogeneous space $\mathbb{M}_2$ of 2D positions and orientations. We formulate a theorem that describes all shortest and straight curves (parallel velocity and parallel momentum, respectively) with respect to this new data-driven connection and corresponding Riemannian manifold. Then we use these shortest curves for geodesic… ▽ More We introduce a data-driven version of the plus Cartan connection on the homogeneous space $\mathbb{M}_2$ of 2D positions and orientations. We formulate a theorem that describes all shortest and straight curves (parallel velocity and parallel momentum, respectively) with respect to this new data-driven connection and corresponding Riemannian manifold. Then we use these shortest curves for geodesic tracking of complex vasculature in multi-orientation image representations defined on $\mathbb{M}_{2}$. The data-driven Cartan connection characterizes the Hamiltonian flow of all geodesics. It also allows for improved adaptation to curvature and misalignment of the (lifted) vessel structure that we track via globally optimal geodesics. We compute these geodesics numerically via steepest descent on distance maps on $\mathbb{M}_2$ that we compute by a new modified anisotropic fast-marching method. Our experiments range from tracking single blood vessels with fixed endpoints to tracking complete vascular trees in retinal images. Single vessel tracking is performed in a single run in the multi-orientation image representation, where we project the resulting geodesics back onto the underlying image. The complete vascular tree tracking requires only two runs and avoids prior segmentation, placement of extra anchor points, and dynamic switching between geodesic models. Altogether we provide a geodesic tracking method using a single, flexible, transparent, data-driven geodesic model providing globally optimal curves which correctly follow highly complex vascular structures in retinal images. All experiments in this article can be reproduced via documented Mathematica notebooks available at GitHub (https://github.com/NickyvdBerg/DataDrivenTracking). △ Less

Submitted 8 December, 2023; v1 submitted 23 August, 2022; originally announced August 2022.

Non-thermal evolution of dense plasmas driven by intense x-ray fields

Authors: Shenyuan Ren, Yuanfeng Shi, Quincy Y. van den Berg, Muhammad Firmansyah, Hyun-Kyung Chung, Elisa V. Fernandez-Tello, Pedro Velarde, Justin S. Wark, Sam M. Vinko

Abstract: The advent of x-ray free-electron lasers (XFELs) has enabled a range of new experimental investigations into the properties of matter driven to extreme conditions via intense x-ray-matter interactions. The femtosecond timescales of these interactions lead to the creation of transient high-energy-density plasmas, where both the electrons and the ions may be far from local thermodynamic equilibrium… ▽ More The advent of x-ray free-electron lasers (XFELs) has enabled a range of new experimental investigations into the properties of matter driven to extreme conditions via intense x-ray-matter interactions. The femtosecond timescales of these interactions lead to the creation of transient high-energy-density plasmas, where both the electrons and the ions may be far from local thermodynamic equilibrium (LTE). Predictive modelling of such systems remains challenging because of the substantially different timescales on which electrons and ions thermalize, and because of the vast number of atomic configurations that are required to describe the resulting highly-ionized plasmas. Here we explore the evolution of systems driven to high energy densities using CCFLY, a non-LTE, Fokker-Planck collisional-radiative code. We use CCFLY to investigate the evolution dynamics of a solid-density plasma driven by an XFEL, and explore the relaxation of the plasma to local thermodynamic equilibrium on femtosecond timescales in terms of the charge state distribution, electron density, and temperature. △ Less

Submitted 5 August, 2022; v1 submitted 31 July, 2022; originally announced August 2022.

Towards computational Morse-Floer homology: forcing results for connecting orbits by computing relative indices of critical points

Authors: Jan Bouwe van den Berg, Marcio Gameiro, Jean-Philippe Lessard, Rob van der Vorst

Abstract: To make progress towards better computability of Morse-Floer homology, and thus enhance the applicability of Floer theory, it is essential to have tools to determine the relative index of equilibria. Since even the existence of nontrivial stationary points is often difficult to accomplish, extracting their index information is usually out of reach. In this paper we establish a computer-assisted pr… ▽ More To make progress towards better computability of Morse-Floer homology, and thus enhance the applicability of Floer theory, it is essential to have tools to determine the relative index of equilibria. Since even the existence of nontrivial stationary points is often difficult to accomplish, extracting their index information is usually out of reach. In this paper we establish a computer-assisted proof approach to determining relative indices of stationary states. We introduce the general framework and then focus on three example problems described by partial differential equations to show how these ideas work in practice. Based on a rigorous implementation, with accompanying code made available, we determine the relative indices of many stationary points. Moreover, we show how forcing results can be then used to prove theorems about connecting orbits and traveling waves in partial differential equations. △ Less

Submitted 27 October, 2023; v1 submitted 18 June, 2022; originally announced June 2022.

Comments: 30 pages, 4 figures. Revised accepted version

MSC Class: 57R58; 35R25; 65M30; 65G40; 35K57

Lane-Level Route Planning for Autonomous Vehicles

Authors: Mitchell Jones, Maximilian Haas-Heger, Jur van den Berg

Abstract: We present an algorithm that, given a representation of a road network in lane-level detail, computes a route that minimizes the expected cost to reach a given destination. In doing so, our algorithm allows us to solve for the complex trade-offs encountered when trying to decide not just which roads to follow, but also when to change between the lanes making up these roads, in order to -- for exam… ▽ More We present an algorithm that, given a representation of a road network in lane-level detail, computes a route that minimizes the expected cost to reach a given destination. In doing so, our algorithm allows us to solve for the complex trade-offs encountered when trying to decide not just which roads to follow, but also when to change between the lanes making up these roads, in order to -- for example -- reduce the likelihood of missing a left exit while not unnecessarily driving in the leftmost lane. This routing problem can naturally be formulated as a Markov Decision Process (MDP), in which lane change actions have stochastic outcomes. However, MDPs are known to be time-consuming to solve in general. In this paper, we show that -- under reasonable assumptions -- we can use a Dijkstra-like approach to solve this stochastic problem, and benefit from its efficient $O(n \log n)$ running time. This enables an autonomous vehicle to exhibit lane-selection behavior as it efficiently plans an optimal route to its destination. △ Less

Submitted 13 July, 2023; v1 submitted 6 June, 2022; originally announced June 2022.

Comments: Appeared at the 15th International Workshop on the Algorithmic Foundations of Robotics (WAFR) 2022