Showing 1–26 of 26 results for author: Fannjiang, C

Is novelty predictable?

Authors: Clara Fannjiang, Jennifer Listgarten

Abstract: Machine learning-based design has gained traction in the sciences, most notably in the design of small molecules, materials, and proteins, with societal implications spanning drug development and manufacturing, plastic degradation, and carbon sequestration. When designing objects to achieve novel property values with machine learning, one faces a fundamental challenge: how to push past the frontie… ▽ More Machine learning-based design has gained traction in the sciences, most notably in the design of small molecules, materials, and proteins, with societal implications spanning drug development and manufacturing, plastic degradation, and carbon sequestration. When designing objects to achieve novel property values with machine learning, one faces a fundamental challenge: how to push past the frontier of current knowledge, distilled from the training data into the model, in a manner that rationally controls the risk of failure. If one trusts learned models too much in extrapolation, one is likely to design rubbish. In contrast, if one does not extrapolate, one cannot find novelty. Herein, we ponder how one might strike a useful balance between these two extremes. We focus in particular on designing proteins with novel property values, although much of our discussion addresses machine learning-based design more broadly. △ Less

Submitted 1 June, 2023; originally announced June 2023.

Machine Learning for Protein Engineering

Authors: Kadina E. Johnston, Clara Fannjiang, Bruce J. Wittmann, Brian L. Hie, Kevin K. Yang, Zachary Wu

Abstract: Directed evolution of proteins has been the most effective method for protein engineering. However, a new paradigm is emerging, fusing the library generation and screening approaches of traditional directed evolution with computation through the training of machine learning models on protein sequence fitness data. This chapter highlights successful applications of machine learning to protein engin… ▽ More Directed evolution of proteins has been the most effective method for protein engineering. However, a new paradigm is emerging, fusing the library generation and screening approaches of traditional directed evolution with computation through the training of machine learning models on protein sequence fitness data. This chapter highlights successful applications of machine learning to protein engineering and directed evolution, organized by the improvements that have been made with respect to each step of the directed evolution cycle. Additionally, we provide an outlook for the future based on the current direction of the field, namely in the development of calibrated models and in incorporating other modalities, such as protein structure. △ Less

Submitted 26 May, 2023; originally announced May 2023.

Comments: Initial book chapter submission on February 28, 2022, to be published by Springer Nature

Prediction-Powered Inference

Authors: Anastasios N. Angelopoulos, Stephen Bates, Clara Fannjiang, Michael I. Jordan, Tijana Zrnic

Abstract: Prediction-powered inference is a framework for performing valid statistical inference when an experimental dataset is supplemented with predictions from a machine-learning system. The framework yields simple algorithms for computing provably valid confidence intervals for quantities such as means, quantiles, and linear and logistic regression coefficients, without making any assumptions on the ma… ▽ More Prediction-powered inference is a framework for performing valid statistical inference when an experimental dataset is supplemented with predictions from a machine-learning system. The framework yields simple algorithms for computing provably valid confidence intervals for quantities such as means, quantiles, and linear and logistic regression coefficients, without making any assumptions on the machine-learning algorithm that supplies the predictions. Furthermore, more accurate predictions translate to smaller confidence intervals. Prediction-powered inference could enable researchers to draw valid and more data-efficient conclusions using machine learning. The benefits of prediction-powered inference are demonstrated with datasets from proteomics, astronomy, genomics, remote sensing, census analysis, and ecology. △ Less

Submitted 9 November, 2023; v1 submitted 23 January, 2023; originally announced January 2023.

Comments: Code is available at https://github.com/aangelopoulos/ppi_py

Conformal prediction for the design problem

Authors: Clara Fannjiang, Stephen Bates, Anastasios N. Angelopoulos, Jennifer Listgarten, Michael I. Jordan

Abstract: Many applications of machine learning methods involve an iterative protocol in which data are collected, a model is trained, and then outputs of that model are used to choose what data to consider next. For example, one data-driven approach for designing proteins is to train a regression model to predict the fitness of protein sequences, then use it to propose new sequences believed to exhibit gre… ▽ More Many applications of machine learning methods involve an iterative protocol in which data are collected, a model is trained, and then outputs of that model are used to choose what data to consider next. For example, one data-driven approach for designing proteins is to train a regression model to predict the fitness of protein sequences, then use it to propose new sequences believed to exhibit greater fitness than observed in the training data. Since validating designed sequences in the wet lab is typically costly, it is important to quantify the uncertainty in the model's predictions. This is challenging because of a characteristic type of distribution shift between the training and test data in the design setting -- one in which the training and test data are statistically dependent, as the latter is chosen based on the former. Consequently, the model's error on the test data -- that is, the designed sequences -- has an unknown and possibly complex relationship with its error on the training data. We introduce a method to quantify predictive uncertainty in such settings. We do so by constructing confidence sets for predictions that account for the dependence between the training and test data. The confidence sets we construct have finite-sample guarantees that hold for any prediction algorithm, even when a trained model chooses the test-time input distribution. As a motivating use case, we demonstrate with several real data sets how our method quantifies uncertainty for the predicted fitness of designed proteins, and can therefore be used to select design algorithms that achieve acceptable trade-offs between high predicted fitness and low predictive uncertainty. △ Less

Submitted 31 May, 2022; v1 submitted 7 February, 2022; originally announced February 2022.

Comments: for associated code, see https://github.com/clarafy/conformal-for-design

Journal ref: Proc. Natl. Acad. Sci. 119 (43) e2204569119 (2022)

Variational Refinement for Importance Sampling Using the Forward Kullback-Leibler Divergence

Authors: Ghassen Jerfel, Serena Wang, Clara Fannjiang, Katherine A. Heller, Yian Ma, Michael I. Jordan

Abstract: Variational Inference (VI) is a popular alternative to asymptotically exact sampling in Bayesian inference. Its main workhorse is optimization over a reverse Kullback-Leibler divergence (RKL), which typically underestimates the tail of the posterior leading to miscalibration and potential degeneracy. Importance sampling (IS), on the other hand, is often used to fine-tune and de-bias the estimates… ▽ More Variational Inference (VI) is a popular alternative to asymptotically exact sampling in Bayesian inference. Its main workhorse is optimization over a reverse Kullback-Leibler divergence (RKL), which typically underestimates the tail of the posterior leading to miscalibration and potential degeneracy. Importance sampling (IS), on the other hand, is often used to fine-tune and de-bias the estimates of approximate Bayesian inference procedures. The quality of IS crucially depends on the choice of the proposal distribution. Ideally, the proposal distribution has heavier tails than the target, which is rarely achievable by minimizing the RKL. We thus propose a novel combination of optimization and sampling techniques for approximate Bayesian inference by constructing an IS proposal distribution through the minimization of a forward KL (FKL) divergence. This approach guarantees asymptotic consistency and a fast convergence towards both the optimal IS estimator and the optimal variational approximation. We empirically demonstrate on real data that our method is competitive with variational boosting and MCMC. △ Less

Submitted 30 June, 2021; originally announced June 2021.

Comments: Accepted for the 37th Conference on Uncertainty in Artificial Intelligence (UAI 2021)

Autofocused oracles for model-based design

Authors: Clara Fannjiang, Jennifer Listgarten

Abstract: Data-driven design is making headway into a number of application areas, including protein, small-molecule, and materials engineering. The design goal is to construct an object with desired properties, such as a protein that binds to a therapeutic target, or a superconducting material with a higher critical temperature than previously observed. To that end, costly experimental measurements are bei… ▽ More Data-driven design is making headway into a number of application areas, including protein, small-molecule, and materials engineering. The design goal is to construct an object with desired properties, such as a protein that binds to a therapeutic target, or a superconducting material with a higher critical temperature than previously observed. To that end, costly experimental measurements are being replaced with calls to high-capacity regression models trained on labeled data, which can be leveraged in an in silico search for design candidates. However, the design goal necessitates moving into regions of the design space beyond where such models were trained. Therefore, one can ask: should the regression model be altered as the design algorithm explores the design space, in the absence of new data? Herein, we answer this question in the affirmative. In particular, we (i) formalize the data-driven design problem as a non-zero-sum game, (ii) develop a principled strategy for retraining the regression model as the design algorithm proceeds---what we refer to as autofocusing, and (iii) demonstrate the promise of autofocusing empirically. △ Less

Submitted 24 October, 2020; v1 submitted 14 June, 2020; originally announced June 2020.

Comments: 23 pages, 6 figures

A view of Estimation of Distribution Algorithms through the lens of Expectation-Maximization

Authors: David H. Brookes, Akosua Busia, Clara Fannjiang, Kevin Murphy, Jennifer Listgarten

Abstract: We show that a large class of Estimation of Distribution Algorithms, including, but not limited to, Covariance Matrix Adaption, can be written as a Monte Carlo Expectation-Maximization algorithm, and as exact EM in the limit of infinite samples. Because EM sits on a rigorous statistical foundation and has been thoroughly analyzed, this connection provides a new coherent framework with which to rea… ▽ More We show that a large class of Estimation of Distribution Algorithms, including, but not limited to, Covariance Matrix Adaption, can be written as a Monte Carlo Expectation-Maximization algorithm, and as exact EM in the limit of infinite samples. Because EM sits on a rigorous statistical foundation and has been thoroughly analyzed, this connection provides a new coherent framework with which to reason about EDAs. △ Less

Submitted 10 June, 2022; v1 submitted 24 May, 2019; originally announced May 2019.

Optimal Arrays for Compressed Sensing in Snapshot-Mode Radio Interferometry

Authors: Clara Fannjiang

Abstract: Radio interferometry has always faced the problem of incomplete sampling of the Fourier plane. A possible remedy can be found in the promising new theory of compressed sensing (CS), which allows for the accurate recovery of sparse signals from sub-Nyquist sampling given certain measurement conditions. We provide an introductory assessment of optimal arrays for CS in snapshot-mode radio interferome… ▽ More Radio interferometry has always faced the problem of incomplete sampling of the Fourier plane. A possible remedy can be found in the promising new theory of compressed sensing (CS), which allows for the accurate recovery of sparse signals from sub-Nyquist sampling given certain measurement conditions. We provide an introductory assessment of optimal arrays for CS in snapshot-mode radio interferometry, using orthogonal matching pursuit (OMP), a widely used CS recovery algorithm similar in some respects to CLEAN. We focus on centrally condensed (specifically, Gaussian) arrays versus uniform arrays, and the principle of randomization versus deterministic arrays such as the VLA. The theory of CS is grounded in $a)$ sparse representation of signals and $b)$ measurement matrices of low coherence. We calculate a related quantity, mutual coherence (MC), as a theoretical indicator of arrays' suitability for OMP based on the recovery error bounds in (Donoho et al. 2006). OMP reconstructions of both point and extended objects are also run from simulated incomplete data. Optimal arrays are considered for object recovery through 1) the natural pixel representation and 2) the representation by the block discrete cosine transform (BDCT). We find that reconstructions of the pixel representation perform best with the uniform random array, while reconstructions of the BDCT representation perform best with normal random arrays. Slight randomization to the VLA also improves it hugely for CS with the pixel basis. In the pixel basis, array design for CS reflects known principles of array design for small numbers of antennas, namely of randomness and uniform distribution. Differing results with the BDCT, however, emphasize the importance of studying how sparsifying bases affect array design before CS can be optimized. △ Less

Submitted 18 December, 2015; originally announced December 2015.

Journal ref: Astronomy & Astrophysics, 559, A73 (2013)

The MUSIC Algorithm for Sparse Objects: A Compressed Sensing Analysis

Authors: Albert C. Fannjiang

Abstract: The MUSIC algorithm, with its extension for imaging sparse {\em extended} objects, is analyzed by compressed sensing (CS) techniques. The notion of restricted isometry property (RIP) and an upper bound on the restricted isometry constant (RIC) are employed to establish sufficient conditions for the exact localization by MUSIC with or without the presence of noise. In the noiseless case, the suffic… ▽ More The MUSIC algorithm, with its extension for imaging sparse {\em extended} objects, is analyzed by compressed sensing (CS) techniques. The notion of restricted isometry property (RIP) and an upper bound on the restricted isometry constant (RIC) are employed to establish sufficient conditions for the exact localization by MUSIC with or without the presence of noise. In the noiseless case, the sufficient condition gives an upper bound on the numbers of random sampling and incident directions necessary for exact localization. In the noisy case, the sufficient condition assumes additionally an upper bound for the noise-to-object ratio in terms of the RIC and the condition number of objects. Rigorous comparison of performance between MUSIC and the CS minimization principle, Lasso, is given. In general, the MUSIC algorithm guarantees to recover, with high probability, $s$ scatterers with $n=\cO(s^2)$ random sampling and incident directions and sufficiently high frequency. For the favorable imaging geometry where the scatterers are distributed on a transverse plane MUSIC guarantees to recover, with high probability, $s$ scatterers with a median frequency and $n=\cO(s)$ random sampling/incident directions. Numerical results confirm that the Lasso outperforms MUSIC in the well-resolved case while the opposite is true for the under-resolved case. The latter effect indicates the superresolution capability of the MUSIC algorithm. Another advantage of MUSIC over the Lasso as applied to imaging is the former's flexibility with grid spacing and guarantee of {\em approximate} localization of sufficiently separated objects in an arbitrarily fine grid. The error can be bounded from above by $\cO(λs)$ for general configurations and $\cO(λ)$ for objects distributed in a transverse plane. △ Less

Submitted 8 November, 2010; v1 submitted 8 June, 2010; originally announced June 2010.

Comments: Strengthen and in some cases simplify the results in v.2

MSC Class: 74G75

Compressive Inverse Scattering II. SISO Measurements with Born scatterers

Authors: Albert C. Fannjiang

Abstract: Inverse scattering methods capable of compressive imaging are proposed and analyzed. The methods employ randomly and repeatedly (multiple-shot) the single-input-single-output (SISO) measurements in which the probe frequencies, the incident and the sampling directions are related in a precise way and are capable of recovering exactly scatterers of sufficiently low sparsity. For point targets, v… ▽ More Inverse scattering methods capable of compressive imaging are proposed and analyzed. The methods employ randomly and repeatedly (multiple-shot) the single-input-single-output (SISO) measurements in which the probe frequencies, the incident and the sampling directions are related in a precise way and are capable of recovering exactly scatterers of sufficiently low sparsity. For point targets, various sampling techniques are proposed to transform the scattering matrix into the random Fourier matrix. The results for point targets are then extended to the case of localized extended targets by interpolating from grid points. In particular, an explicit error bound is derived for the piece-wise constant interpolation which is shown to be a practical way of discretizing localized extended targets and enabling the compressed sensing techniques. For distributed extended targets, the Littlewood-Paley basis is used in analysis. A specially designed sampling scheme then transforms the scattering matrix into a block-diagonal matrix with each block being the random Fourier matrix corresponding to one of the multiple dyadic scales of the extended target. In other words by the Littlewood-Paley basis and the proposed sampling scheme the different dyadic scales of the target are decoupled and therefore can be reconstructed scale-by-scale by the proposed method. Moreover, with probes of any single frequency $\om$ the coefficients in the Littlewood-Paley expansion for scales up to $\om/(2π)$ can be exactly recovered. △ Less

Submitted 4 January, 2010; v1 submitted 27 August, 2009; originally announced August 2009.

Comments: Add a new section (Section 3) on localized extended targets

Compressive Inverse Scattering I. High Frequency SIMO Measurements

Authors: Albert C. Fannjiang

Abstract: Inverse scattering from discrete targets with the single-input-multiple-output (SIMO), multiple-input-single-output (MISO) or multiple-input-multiple-output (MIMO) measurements is analyzed by compressed sensing theory with and without the Born approximation. High frequency analysis of (probabilistic) recoverability by the $L^1$-based minimization/regularization principles is presented. In the ab… ▽ More Inverse scattering from discrete targets with the single-input-multiple-output (SIMO), multiple-input-single-output (MISO) or multiple-input-multiple-output (MIMO) measurements is analyzed by compressed sensing theory with and without the Born approximation. High frequency analysis of (probabilistic) recoverability by the $L^1$-based minimization/regularization principles is presented. In the absence of noise, it is shown that the $L^1$-based solution can recover exactly the target of sparsity up to the dimension of the data either with the MIMO measurement for the Born scattering or with the SIMO/MISO measurement for the exact scattering. The stability with respect to noisy data is proved for weak or widely separated scatterers. Reciprocity between the SIMO and MISO measurements is analyzed. Finally a coherence bound (and the resulting recoverability) is proved for diffraction tomography with high-frequency, few-view and limited-angle SIMO/MISO measurements. △ Less

Submitted 17 January, 2010; v1 submitted 30 June, 2009; originally announced June 2009.

Comments: A new section on diffraction tomography added; typos fixed; new figures added

Compressive Imaging of Subwavelength Structures

Authors: Albert C. Fannjiang

Abstract: The problem of imaging extended targets (sources or scatterers) is formulated in the framework of compressed sensing with emphasis on subwavelength resolution. The proposed formulation of the problems of inverse source/scattering is essentially exact and leads to the random partial Fourier measurement matrix. In the case of square-integrable targets, the proposed sampling scheme in the Littlew… ▽ More The problem of imaging extended targets (sources or scatterers) is formulated in the framework of compressed sensing with emphasis on subwavelength resolution. The proposed formulation of the problems of inverse source/scattering is essentially exact and leads to the random partial Fourier measurement matrix. In the case of square-integrable targets, the proposed sampling scheme in the Littlewood-Paley wavelet basis block-diagonalizes the scattering matrix with each block in the form of random partial Fourier matrix corresponding to each dyadic scale of the target. The resolution issue is analyzed from two perspectives: stability and the signal-to-noise ratio (SNR). The subwavelength modes are shown to be typically unstable. The stability in the subwavelength modes requires additional techniques such as near-field measurement or illumination. The number of the stable modes typically increases as the negative $d$-th (the dimension of the target) power of the distance between the target and the sensors/source. The resolution limit is shown to be inversely proportional to the SNR in the high SNR limit. Numerical simulations are provided to validate the theoretical predictions. △ Less

Submitted 15 September, 2009; v1 submitted 18 May, 2009; originally announced May 2009.

Comments: A new section on imaging with Littlewood-Paley basis is added

On time reversal mirrors

Authors: Albert C. Fannjiang

Abstract: The concept of time reversal (TR) of scalar wave is reexamined from basic principles. Five different time reversal mirrors (TRM) are introduced and their relations are analyzed. For the boundary behavior, it is shown that for paraxial wave only the monopole TR scheme satisfies the exact boundary condition while for spherical wave only one of the mixed mode TR scheme, after multiplication by two,… ▽ More The concept of time reversal (TR) of scalar wave is reexamined from basic principles. Five different time reversal mirrors (TRM) are introduced and their relations are analyzed. For the boundary behavior, it is shown that for paraxial wave only the monopole TR scheme satisfies the exact boundary condition while for spherical wave only one of the mixed mode TR scheme, after multiplication by two, satisfies the exact boundary condition. The asymptotic analysis of the near-field focusing property is presented. It is shown that to have a subwavelength focal spot the TRM should involve dipole fields. The monopole TR is extremely ineffective to focus below wavelength as the focal spot size decreases logarithmically with the distance between the source and TRM. Contrary to the matched field processing and the phase processor, both of which resemble TR, TR in a weak- or non-scattering medium is usually biased in the longitudinal direction, especially when TR is carried out on a {\em single} plane with a {finite} aperture. This is true for all five TR schemes. On the other hand, the TR focal spot has been shown repeatedly in the literature, both theoretically and experimentally, to be centered at the source point when the medium is multiply scattering. A reconciliation of the two seemingly conflicting results is found in the random fluctuations in the intensity of the Green function for a multiply scattering medium and the notion of scattering-enlarged effective aperture. △ Less

Submitted 10 July, 2009; v1 submitted 2 November, 2008; originally announced November 2008.

Mutual Coherence of Polarized Light in Disordered Media: Two-Frequency Method Extended

Authors: Albert C. Fannjiang

Abstract: The paper addresses the two-point correlations of electromagnetic waves in general random, bi-anisotropic media whose constitutive tensors are complex Hermitian, positive- or negative-definite matrices. A simplified version of the two-frequency Wigner distribution (2f-WD) for polarized waves is introduced and the closed form Wigner-Moyal equation is derived from the Maxwell equations. In the wea… ▽ More The paper addresses the two-point correlations of electromagnetic waves in general random, bi-anisotropic media whose constitutive tensors are complex Hermitian, positive- or negative-definite matrices. A simplified version of the two-frequency Wigner distribution (2f-WD) for polarized waves is introduced and the closed form Wigner-Moyal equation is derived from the Maxwell equations. In the weak-disorder regime with an arbitrarily varying background the two-frequency radiative transfer (2f-RT) equations for the associated $2\times 2$ coherence matrices are derived from the Wigner-Moyal equation by using the multiple scale expansion. In birefringent media, the coherence matrix becomes a scalar and the 2f-RT equations take the scalar form due to the absence of depolarization. A paraxial approximation is developed for spatialy anisotropic media. Examples of isotropic, chiral, uniaxial and gyrotropic media are discussed. △ Less

Submitted 1 October, 2007; v1 submitted 29 August, 2007; originally announced August 2007.

Journal ref: Journal of Physics A.: Math. Theor. (2007)

Two-Frequency Radiative Transfer. II: Maxwell Equations in Random Dielectrics

Authors: Albert C. Fannjiang

Abstract: The paper addresses the space-frequency correlations of electromagnetic waves in general random, bi-anisotropic media whose constitutive tensors are complex Hermitian matrices. The two-frequency Wigner distribution (2f-WD) for polarized waves is introduced to describe the space-frequency correlations and the closed form Wigner-Moyal equation is derived from the Maxwell equations. Two-frequency r… ▽ More The paper addresses the space-frequency correlations of electromagnetic waves in general random, bi-anisotropic media whose constitutive tensors are complex Hermitian matrices. The two-frequency Wigner distribution (2f-WD) for polarized waves is introduced to describe the space-frequency correlations and the closed form Wigner-Moyal equation is derived from the Maxwell equations. Two-frequency radiative transfer (2f-RT) equations is then derived from the Wigner-Moyal equation by using the multiple scale expansion. For the simplest isotropic medium, the result coincides with Chandrasekhar's transfer equation. In birefringent media, the 2f-RT equations take the scalar form due to the absence of depolarization. A number of birefringent media such as the chiral, uniaxial and gyrotropic media are examined. For the unpolarized wave in the isotropic medium the 2f-RT equations reduces to the Fokker-Planck equation previously derived in Part I. A similar Fokker-Planck equation is derived from the scalar 2f-RT equation for the birefringent media. △ Less

Submitted 1 October, 2007; v1 submitted 10 July, 2007; originally announced July 2007.

Comments: Change certain notations throughout the paper

Journal ref: Journal of Optical Society of America A (2007)

Space-frequency correlation of classical waves in disordered media: high-frequency and small scale asymptotics

Authors: Albert C. Fannjiang

Abstract: Two-frequency radiative transfer (2f-RT) theory is developed for geometrical optics in random media. The space-frequency correlation is described by the two-frequency Wigner distribution (2f-WD) which satisfies a closed form equation, the two-frequency Wigner-Moyal equation. In the RT regime it is proved rigorously that 2f-WD satisfies a Fokker-Planck-like equation with complex-valued coefficien… ▽ More Two-frequency radiative transfer (2f-RT) theory is developed for geometrical optics in random media. The space-frequency correlation is described by the two-frequency Wigner distribution (2f-WD) which satisfies a closed form equation, the two-frequency Wigner-Moyal equation. In the RT regime it is proved rigorously that 2f-WD satisfies a Fokker-Planck-like equation with complex-valued coefficients. By dimensional analysis 2f-RT equation yields the scaling behavior of three physical parameters: the spatial spread, the coherence length and the coherence bandwidth. The sub-transport-mean-free-path behavior is obtained in a closed form by analytically solving a paraxial 2f-RT equation. △ Less

Submitted 25 June, 2007; originally announced June 2007.

Two-Frequency Radiative Transfer and Asymptotic Solution

Authors: Albert C. Fannjiang

Abstract: Two-frequency radiative transfer (2f-RT) theory is developed for classical waves in random media. Depending on the ratio of the wavelength to the scale of medium fluctuation 2f-RT equation is either a Boltzmann-like integral equation with a complex-valued kernel or a Fokker-Planck-like differential equation with complex-valued coefficients in the phase space. The 2f-RT equation is used to estima… ▽ More Two-frequency radiative transfer (2f-RT) theory is developed for classical waves in random media. Depending on the ratio of the wavelength to the scale of medium fluctuation 2f-RT equation is either a Boltzmann-like integral equation with a complex-valued kernel or a Fokker-Planck-like differential equation with complex-valued coefficients in the phase space. The 2f-RT equation is used to estimate three physical parameters: the spatial spread, the coherence length and the coherence bandwidth (Thouless frequency). A closed form solution is given for the boundary layer behavior of geometrical radiative transfer and shows highly nontrivial dependence of mutual coherence on the spatial displacement and frequency difference. It is shown that the paraxial form of 2f-RT arises naturally in anisotropic media which fluctuate slowly in the longitudinal direction. △ Less

Submitted 24 April, 2007; v1 submitted 17 October, 2006; originally announced October 2006.

Comments: Typos corrected

Journal ref: Journal of Optical Society of America A Vol. 24, No. 8/August 2007

Self-Averaging Scaling Limits of Two-Frequency Wigner Distribution for Random Paraxial Waves

Authors: Albert C. Fannjiang

Abstract: Two-frequency Wigner distribution is introduced to capture the asymptotic behavior of the space-frequency correlation of paraxial waves in the radiative transfer limits. The scaling limits give rises to deterministic transport-like equations. Depending on the ratio of the wavelength to the correlation length the limiting equation is either a Boltzmann-like integral equation or a Fokker-Planck-li… ▽ More Two-frequency Wigner distribution is introduced to capture the asymptotic behavior of the space-frequency correlation of paraxial waves in the radiative transfer limits. The scaling limits give rises to deterministic transport-like equations. Depending on the ratio of the wavelength to the correlation length the limiting equation is either a Boltzmann-like integral equation or a Fokker-Planck-like differential equation in the phase space. The solutions to these equations have a probabilistic representation which can be simulated by Monte Carlo method. When the medium fluctuates more rapidly in the longitudinal direction, the corresponding Fokker-Planck-like equation can be solved exactly. △ Less

Submitted 24 April, 2007; v1 submitted 22 September, 2006; originally announced September 2006.

Comments: typos corrected

Journal ref: J. Phys. A: Math. Theor. 40 (2007) 5025-5044

Nonlinear Schrödinger Equation with a White-Noise Potential: Phase-space Approach to Spread and Singularity

Authors: Albert C. Fannjiang

Abstract: We propose a phase-space formulation for the nonlinear Schrödinger equation with a white-noise potential in order to shed light on two issues: the rate of spread and the singularity formation in the average sense. Our main tools are the energy law and the variance identity. The method is completely elementary. For the problem of wave spread, we show that the ensemble-averaged dispersion in the… ▽ More We propose a phase-space formulation for the nonlinear Schrödinger equation with a white-noise potential in order to shed light on two issues: the rate of spread and the singularity formation in the average sense. Our main tools are the energy law and the variance identity. The method is completely elementary. For the problem of wave spread, we show that the ensemble-averaged dispersion in the critical or defocusing case follows the cubic-in-time law while in the supercritical and subcritical focusing cases the cubic law becomes an upper and lower bounds respectively. We have also found that in the critical and supercritical focusing cases the presence of a white-noise random potential results in different conditions for singularity-with-positive-probability from the homogeneous case but does not prevent singularity formation. We show that in the supercritical focusing case the ensemble-averaged self-interaction energy and the momentum variance can exceed any fixed level in a finite time with positive probability. △ Less

Submitted 2 October, 2005; v1 submitted 27 March, 2005; originally announced March 2005.

Journal ref: Physica D, Volume 212, Issues 3-4, 2005, Pages 195-204

Self-Averaged Scaling Limits for Random Parabolic Waves

Authors: Albert C. Fannjiang

Abstract: We consider 6 types of scaling limits for the Wigner-Moyal equation of the parabolic waves in random media, the limiting cases of which include the radiative transfer limit, the diffusion limit and the white-noise limit. We show under fairly general assumptions on the random refractive index field that sufficient amount of medium diversity (thus excluding the white-noise limit) leads to statisti… ▽ More We consider 6 types of scaling limits for the Wigner-Moyal equation of the parabolic waves in random media, the limiting cases of which include the radiative transfer limit, the diffusion limit and the white-noise limit. We show under fairly general assumptions on the random refractive index field that sufficient amount of medium diversity (thus excluding the white-noise limit) leads to statistical stability or self-averaging in the sense that the limiting law is deterministic and is governed by various transport equations depending on the specific scaling involved. We obtain 6 different radiative transfer equations as limits. △ Less

Submitted 4 February, 2004; v1 submitted 30 May, 2003; originally announced June 2003.

Journal ref: Archives of Rational Mechanics and Analysis 175:3 (2005), pp. 343 - 387

White-Noise and Geometrical Optics Limits of Wigner-Moyal Equation for Wave Beams in Turbulent Media

Authors: Albert C. Fannjiang

Abstract: Starting with the Wigner distribution formulation for beam wave propagation in Hölder continuous non-Gaussian random refractive index fields we show that the wave beam regime naturally leads to the white-noise scaling limit and converges to a Gaussian white-noise model which is characterized by the martingale problem associated to a stochastic differential-integral equation of the Itô type. In t… ▽ More Starting with the Wigner distribution formulation for beam wave propagation in Hölder continuous non-Gaussian random refractive index fields we show that the wave beam regime naturally leads to the white-noise scaling limit and converges to a Gaussian white-noise model which is characterized by the martingale problem associated to a stochastic differential-integral equation of the Itô type. In the simultaneous geometrical optics the convergence to the Gaussian white-noise model for the Liouville equation is also established if the ultraviolet cutoff or the Fresnel number vanishes sufficiently slowly. The advantage of the Gaussian white-noise model is that its $n$-point correlation functions are governed by closed form equations. △ Less

Submitted 5 March, 2004; v1 submitted 15 April, 2003; originally announced April 2003.

Convergence of Passive Scalars in Ornstein-Uhlenbeck Flows to Kraichnan's Model

Authors: Albert C. Fannjiang

Abstract: We prove that the passive scalar field in the Ornstein-Uhlenbeck velocity field with wave-number dependent correlation times converges, in the white-noise limit, to that of Kraichnan's model with higher spatial regularity. We prove that the passive scalar field in the Ornstein-Uhlenbeck velocity field with wave-number dependent correlation times converges, in the white-noise limit, to that of Kraichnan's model with higher spatial regularity. △ Less

Submitted 26 March, 2003; v1 submitted 5 September, 2002; originally announced September 2002.

Richardson's Laws for Relative Dispersion in Colored-Noise Flows with Kolmogorov-type Spectra

Authors: Albert C. Fannjiang

Abstract: We prove limit theorems for small-scale pair dispersion in velocity fields with power-law spatial spectra and wave-number dependent correlation times. This result establishes rigorously a family of generalized Richardson's laws with a limiting case corresponding to Richardson's $t^3$ and 4/3-laws. We prove limit theorems for small-scale pair dispersion in velocity fields with power-law spatial spectra and wave-number dependent correlation times. This result establishes rigorously a family of generalized Richardson's laws with a limiting case corresponding to Richardson's $t^3$ and 4/3-laws. △ Less

Submitted 26 March, 2003; v1 submitted 3 September, 2002; originally announced September 2002.

Phase Diagram for Turbulent Transport: Sampling Drift, Eddy Diffusivity and Variational Principles

Authors: Albert C. Fannjiang

Abstract: We study the long-time, large scale transport in a three-parameter family of isotropic, incompressible velocity fields with power-law spectra. Scaling law for transport is characterized by the scaling exponent $q$ and the Hurst exponent $H$, as functions of the parameters. The parameter space is divided into regimes of scaling laws of different {\em functional forms} of the scaling exponent and… ▽ More We study the long-time, large scale transport in a three-parameter family of isotropic, incompressible velocity fields with power-law spectra. Scaling law for transport is characterized by the scaling exponent $q$ and the Hurst exponent $H$, as functions of the parameters. The parameter space is divided into regimes of scaling laws of different {\em functional forms} of the scaling exponent and the Hurst exponent. We present the full three-dimensional phase diagram. The limiting process is one of three kinds: Brownian motion ($H=1/2$), persistent fractional Brownian motions ($1/2<H<1$) and regular (or smooth) motion (H=1). We discover that a critical wave number divides the infrared cutoffs into three categories, critical, subcritical and supercritical; they give rise to different scaling laws and phase diagrams. We introduce the notions of sampling drift and eddy diffusivity, and formulate variational principles to estimate the eddy diffusivity. We show that fractional Brownian motions result from a dominant sampling drift. △ Less

Submitted 8 June, 1999; originally announced June 1999.

Report number: UC Davis Math 1999-13

Integral Equations with Hypersingular Kernels -- Theory and Applications to Fracture Mechanics

Authors: Youn-Sha Chan, Albert C. Fannjiang, Glaucio H. Paulino

Abstract: Hypersingular integrals of the type $I_α(T_n,m,r) = \int_{-1}^{1} \hpsngAbs \frac{T_n(s)(1-s^2)^{m-{1/2}}}{(s-r)^α}ds |r|<1$ and $I_α(U_n,m,r) = \int_{-1}^{1} \hpsngAbs \frac{U_n(s)(1-s^2)^{m-{1/2}}}{(s-r)^α}ds |r|<1$ are investigated for general integers $α$ (positive) and $m$ (non-negative), where $T_n(s)$ and $U_n(s)$ are the Tchebyshev polynomials of the 1st and 2nd kinds, respectively. Exac… ▽ More Hypersingular integrals of the type $I_α(T_n,m,r) = \int_{-1}^{1} \hpsngAbs \frac{T_n(s)(1-s^2)^{m-{1/2}}}{(s-r)^α}ds |r|<1$ and $I_α(U_n,m,r) = \int_{-1}^{1} \hpsngAbs \frac{U_n(s)(1-s^2)^{m-{1/2}}}{(s-r)^α}ds |r|<1$ are investigated for general integers $α$ (positive) and $m$ (non-negative), where $T_n(s)$ and $U_n(s)$ are the Tchebyshev polynomials of the 1st and 2nd kinds, respectively. Exact formulas are derived for the cases $α= 1, 2, 3, 4$ and $m = 0, 1, 2, 3$; most of them corresponding to new solutions derived in this paper. Moreover, a systematic approach for evaluating these integrals when $α> 4$ and $m>3$ is provided. The integrals are also evaluated as $|r|>1$ in order to calculate stress intensity factors (SIFs). Examples involving crack problems are given and discussed with emphasis on the linkage between mathematics and mechanics of fracture. The examples include classical linear elastic fracture mechanics (LEFM), functionally graded materials (FGM), and gradient elasticity theory. An appendix, with closed form solutions for a broad class of integrals, supplements the paper. △ Less

Submitted 9 June, 1999; originally announced June 1999.

Report number: UC Davis Math 1999-15

Taylor-Kubo Formula for Turbulent Diffusion in a Non-Mixing Flow with Long-Range Correlation

Authors: Albert C. Fannjiang, Tomasz Komorowski

Abstract: We prove the Taylor-Kubo formula for a class of isotropic, non-mixing flows with long-range correlation. For the proof, we develop the method of high order correctors expansion. We prove the Taylor-Kubo formula for a class of isotropic, non-mixing flows with long-range correlation. For the proof, we develop the method of high order correctors expansion. △ Less

Submitted 8 June, 1999; originally announced June 1999.

Report number: UC Davis Math 1999-14