-
Repelling-Attracting Hamiltonian Monte Carlo
Authors:
Siddharth Vishwanath,
Hyungsuk Tak
Abstract:
We propose a variant of Hamiltonian Monte Carlo (HMC), called the Repelling-Attracting Hamiltonian Monte Carlo (RAHMC), for sampling from multimodal distributions. The key idea that underpins RAHMC is a departure from the conservative dynamics of Hamiltonian systems, which form the basis of traditional HMC, and turning instead to the dissipative dynamics of conformal Hamiltonian systems. In partic…
▽ More
We propose a variant of Hamiltonian Monte Carlo (HMC), called the Repelling-Attracting Hamiltonian Monte Carlo (RAHMC), for sampling from multimodal distributions. The key idea that underpins RAHMC is a departure from the conservative dynamics of Hamiltonian systems, which form the basis of traditional HMC, and turning instead to the dissipative dynamics of conformal Hamiltonian systems. In particular, RAHMC involves two stages: a mode-repelling stage to encourage the sampler to move away from regions of high probability density; and, a mode-attracting stage, which facilitates the sampler to find and settle near alternative modes. We achieve this by introducing just one additional tuning parameter -- the coefficient of friction. The proposed method adapts to the geometry of the target distribution, e.g., modes and density ridges, and can generate proposals that cross low-probability barriers with little to no computational overhead in comparison to traditional HMC. Notably, RAHMC requires no additional information about the target distribution or memory of previously visited modes. We establish the theoretical basis for RAHMC, and we discuss repelling-attracting extensions to several variants of HMC in literature. Finally, we provide a tuning-free implementation via dual-averaging, and we demonstrate its effectiveness in sampling from, both, multimodal and unimodal distributions in high dimensions.
△ Less
Submitted 7 March, 2024;
originally announced March 2024.
-
Conformal field theory for annulus SLE: partition functions and martingale-observables
Authors:
Sung-Soo Byun,
Nam-Gyu Kang,
Hee-Joon Tak
Abstract:
We implement a version of conformal field theory in a doubly connected domain to connect it to the theory of annulus SLE of various types, including the standard annulus SLE, the reversible annulus SLE, and the annulus SLE with several force points. This implementation considers the statistical fields generated under the OPE multiplication by the Gaussian free field and its central/background char…
▽ More
We implement a version of conformal field theory in a doubly connected domain to connect it to the theory of annulus SLE of various types, including the standard annulus SLE, the reversible annulus SLE, and the annulus SLE with several force points. This implementation considers the statistical fields generated under the OPE multiplication by the Gaussian free field and its central/background charge modifications with a weighted combination of Dirichlet and excursion-reflected boundary conditions. We derive the Eguchi-Ooguri version of Ward's equations and Belavin-Polyakov-Zamolodchikov equations for those statistical fields and use them to show that the correlations of fields in the OPE family under the insertion of the one-leg operators are martingale-observables for variants of annulus SLEs. We find Coulomb gas (Dotsenko-Fateev integral) solutions to the parabolic partial differential equations for partition functions of conformal field theory for the reversible annulus SLE.
△ Less
Submitted 18 July, 2021; v1 submitted 10 June, 2018;
originally announced June 2018.
-
Data-dependent Posterior Propriety of Bayesian Beta-Binomial-Logit Model
Authors:
Hyungsuk Tak,
Carl N. Morris
Abstract:
A Beta-Binomial-Logit model is a Beta-Binomial model with covariate information incorporated via a logistic regression. Posterior propriety of a Bayesian Beta-Binomial-Logit model can be data-dependent for improper hyper-prior distributions. Various researchers in the literature have unknowingly used improper posterior distributions or have given incorrect statements about posterior propriety beca…
▽ More
A Beta-Binomial-Logit model is a Beta-Binomial model with covariate information incorporated via a logistic regression. Posterior propriety of a Bayesian Beta-Binomial-Logit model can be data-dependent for improper hyper-prior distributions. Various researchers in the literature have unknowingly used improper posterior distributions or have given incorrect statements about posterior propriety because checking posterior propriety can be challenging due to the complicated functional form of a Beta-Binomial-Logit model. We derive data-dependent necessary and sufficient conditions for posterior propriety within a class of hyper-prior distributions that encompass those used in previous studies.
△ Less
Submitted 22 December, 2015;
originally announced December 2015.
-
Periodically time-varying memory static output feedback control design for discrete-time LTI systems
Authors:
Dong Hwan Lee,
Young Hoon Joo,
Myung Hwan Tak
Abstract:
This paper addresses the problem of static output feedback (SOF) stabilization for discrete-time LTI systems. We approach this problem using the recently developed periodically time-varying memory state-feedback controller (PTVMSFC) design scheme. A bilinear matrix inequality (BMI) condition which uses a pre-designed PTVMSFC is developed to design the periodically time-varying memory SOF controlle…
▽ More
This paper addresses the problem of static output feedback (SOF) stabilization for discrete-time LTI systems. We approach this problem using the recently developed periodically time-varying memory state-feedback controller (PTVMSFC) design scheme. A bilinear matrix inequality (BMI) condition which uses a pre-designed PTVMSFC is developed to design the periodically time-varying memory SOF controller (PTVMSOFC). The BMI condition can be solved by using BMI solvers. Alternatively, we can apply two-steps and iterative linear matrix inequality algorithms that alternate between the PTVMSFC and PTVMSOFC designs. Finally, an example is given to illustrate the proposed methods.
△ Less
Submitted 28 August, 2014;
originally announced August 2014.
-
Conformal field theory of dipolar SLE with the Dirichlet boundary condition
Authors:
Nam-Gyu Kang,
Hee-Joon Tak
Abstract:
We develop a version of dipolar conformal field theory based on the central charge modification of the Gaussian free field with the Dirichlet boundary condition and prove that correlators of certain family of fields in this theory are martingale-observables for dipolar SLE. We prove the restriction property of dipolar SLE(8/3) and Friedrich-Werner's formula in the dipolar case.
We develop a version of dipolar conformal field theory based on the central charge modification of the Gaussian free field with the Dirichlet boundary condition and prove that correlators of certain family of fields in this theory are martingale-observables for dipolar SLE. We prove the restriction property of dipolar SLE(8/3) and Friedrich-Werner's formula in the dipolar case.
△ Less
Submitted 16 July, 2013;
originally announced July 2013.
