Showing 1–7 of 7 results for author: O'Hagan, S

Tree Bandits for Generative Bayes

Authors: Sean O'Hagan, Jungeum Kim, Veronika Rockova

Abstract: In generative models with obscured likelihood, Approximate Bayesian Computation (ABC) is often the tool of last resort for inference. However, ABC demands many prior parameter trials to keep only a small fraction that passes an acceptance test. To accelerate ABC rejection sampling, this paper develops a self-aware framework that learns from past trials and errors. We apply recursive partitioning c… ▽ More In generative models with obscured likelihood, Approximate Bayesian Computation (ABC) is often the tool of last resort for inference. However, ABC demands many prior parameter trials to keep only a small fraction that passes an acceptance test. To accelerate ABC rejection sampling, this paper develops a self-aware framework that learns from past trials and errors. We apply recursive partitioning classifiers on the ABC lookup table to sequentially refine high-likelihood regions into boxes. Each box is regarded as an arm in a binary bandit problem treating ABC acceptance as a reward. Each arm has a proclivity for being chosen for the next ABC evaluation, depending on the prior distribution and past rejections. The method places more splits in those areas where the likelihood resides, shying away from low-probability regions destined for ABC rejections. We provide two versions: (1) ABC-Tree for posterior sampling, and (2) ABC-MAP for maximum a posteriori estimation. We demonstrate accurate ABC approximability at much lower simulation cost. We justify the use of our tree-based bandit algorithms with nearly optimal regret bounds. Finally, we successfully apply our approach to the problem of masked image classification using deep generative models. △ Less

Submitted 16 April, 2024; originally announced April 2024.

Measurement in the Age of LLMs: An Application to Ideological Scaling

Authors: Sean O'Hagan, Aaron Schein

Abstract: Much of social science is centered around terms like ``ideology'' or ``power'', which generally elude precise definition, and whose contextual meanings are trapped in surrounding language. This paper explores the use of large language models (LLMs) to flexibly navigate the conceptual clutter inherent to social scientific measurement tasks. We rely on LLMs' remarkable linguistic fluency to elicit i… ▽ More Much of social science is centered around terms like ``ideology'' or ``power'', which generally elude precise definition, and whose contextual meanings are trapped in surrounding language. This paper explores the use of large language models (LLMs) to flexibly navigate the conceptual clutter inherent to social scientific measurement tasks. We rely on LLMs' remarkable linguistic fluency to elicit ideological scales of both legislators and text, which accord closely to established methods and our own judgement. A key aspect of our approach is that we elicit such scores directly, instructing the LLM to furnish numeric scores itself. This approach affords a great deal of flexibility, which we showcase through a variety of different case studies. Our results suggest that LLMs can be used to characterize highly subtle and diffuse manifestations of political ideology in text. △ Less

Submitted 7 April, 2024; v1 submitted 14 December, 2023; originally announced December 2023.

Comments: Under review a Harvard Data Science Review. Previously presented at the 4th International Conference of Social Computing in Bei**g, China, September 2023, the New Directions in Analyzing Text as Data (TADA) meeting in Amherst, MA, USA, November 2023, and the NeurIPS workshop titled "I Can't Believe It's Not Better!'' Failure Modes in the Age of Foundation Models in New Orleans, LA, December 2023

Efficient Algorithms for Constructing an Interpolative Decomposition

Authors: Rishi Advani, Sean O'Hagan

Abstract: Low-rank approximations are essential in modern data science. The interpolative decomposition provides one such approximation. Its distinguishing feature is that it reuses columns from the original matrix. This enables it to preserve matrix properties such as sparsity and non-negativity. It also helps save space in memory. In this work, we introduce two optimized algorithms to construct an interpo… ▽ More Low-rank approximations are essential in modern data science. The interpolative decomposition provides one such approximation. Its distinguishing feature is that it reuses columns from the original matrix. This enables it to preserve matrix properties such as sparsity and non-negativity. It also helps save space in memory. In this work, we introduce two optimized algorithms to construct an interpolative decomposition along with numerical evidence that they outperform the current state of the art. △ Less

Submitted 7 June, 2022; v1 submitted 14 May, 2021; originally announced May 2021.

Comments: Disclaimer: we do not have any experiments on very large matrices, so these findings are only conclusive for relatively small matrices

MSC Class: 65F55 ACM Class: G.1.3

Random Projections and Dimension Reduction

Authors: Rishi Advani, Madison Crim, Sean O'Hagan

Abstract: This paper, broadly speaking, covers the use of randomness in two main areas: low-rank approximation and kernel methods. Low-rank approximation is very important in numerical linear algebra. Many applications depend on matrix decomposition algorithms that provide accurate low-rank representations of data. In modern problems, however, various factors make this hard to accomplish. One solution to… ▽ More This paper, broadly speaking, covers the use of randomness in two main areas: low-rank approximation and kernel methods. Low-rank approximation is very important in numerical linear algebra. Many applications depend on matrix decomposition algorithms that provide accurate low-rank representations of data. In modern problems, however, various factors make this hard to accomplish. One solution to these problems is the use of random projections. Instead of directly computing the matrix factorization, we randomly project the matrix onto a lower-dimensional subspace and then compute the factorization. Often, we are able to do this without significant loss of accuracy. We describe how randomization can be used to create more efficient algorithms to perform low-rank matrix approximation, as well as introducing a novel randomized algorithm for matrix decomposition. Compared to standard approaches, random algorithms are often faster and more robust. With these randomized algorithms, analyzing massive data sets becomes tractable. Kernel methods are almost diametrically opposite from low-rank approximation. The idea is to project low-dimensional data into a higher-dimensional 'feature space,' such that it is linear separable in the feature space. This enables the model to learn a nonlinear separation of the data. As before, with large data matrices, computing the kernel matrix can be expensive, so we use randomized methods to approximate the matrix. In addition, we propose an extension of the random Fourier features kernel in which hyperparameter values are randomly sampled from an interval or Borel set. The experiments discussed in this paper can be found on our website at https://rishi1999.github.io/random-projections. △ Less

Submitted 11 August, 2020; originally announced August 2020.

Comments: 30 pages

MSC Class: 65F55 (Primary) 62H30 (Secondary) ACM Class: G.1.3

Precise branching ratio measurements in $^{19}$Ne beta decay and fundamental tests of the weak interaction

Authors: B. M. Rebeiro, S. Triambak, P. Z. Mabika, P. Finlay, C. S. Sumithrarachchi, G. Hackman, G. C. Ball, P. E. Garrett, C. E. Svensson, D. S. Cross, R. Dunlop, A. B. Garnsworthy, R. Kshetri, J. N. Orce, M. R. Pearson, E. R. Tardiff, H. Al-Falou, R. A. E. Austin, R. Churchman, M. K. Djongolov, R. D'Entremont, C. Kierans, L. Milovanovic, S. O'Hagan, S. Reeve , et al. (3 additional authors not shown)

Abstract: We used the 8$π$ $γ$-ray spectrometer at the TRIUMF-ISAC radiocative ion beam facility to obtain high-precision branching ratios for $^{19}$Ne $β^+$ decay to excited states in $^{19}$F. Together with other previous work, our measurements determine the superallowed $1/2^+ \to 1/2^+$ beta branch to the ground state in $^{19}$F to be 99.9878(7)\%, which is three times more precise than known previous… ▽ More We used the 8$π$ $γ$-ray spectrometer at the TRIUMF-ISAC radiocative ion beam facility to obtain high-precision branching ratios for $^{19}$Ne $β^+$ decay to excited states in $^{19}$F. Together with other previous work, our measurements determine the superallowed $1/2^+ \to 1/2^+$ beta branch to the ground state in $^{19}$F to be 99.9878(7)\%, which is three times more precise than known previously. The implications of these measurements for testing a variety of weak interaction symmetries are discussed briefly. △ Less

Submitted 16 June, 2019; v1 submitted 4 October, 2018; originally announced October 2018.

Journal ref: Phys. Rev. C 99, 065502 (2019)

Connected Hopf algebras and iterated Ore extensions

Authors: K. A. Brown, S. O'Hagan, J. J. Zhang, G. Zhuang

Abstract: We investigate when a skew polynomial extension T = R[x; σ, δ] of a Hopf algebra R admits a Hopf algebra structure, substantially generalising a theorem of Panov. When this construction is applied iteratively in characteristic 0 one obtains a large family of connected noetherian Hopf algebras of finite Gelfand-Kirillov dimension, including for example all envelo** algebras of finite dimensional… ▽ More We investigate when a skew polynomial extension T = R[x; σ, δ] of a Hopf algebra R admits a Hopf algebra structure, substantially generalising a theorem of Panov. When this construction is applied iteratively in characteristic 0 one obtains a large family of connected noetherian Hopf algebras of finite Gelfand-Kirillov dimension, including for example all envelo** algebras of finite dimensional solvable Lie algebras and all coordinate rings of unipotent groups. The properties of these Hopf algebras are investigated. △ Less

Submitted 5 August, 2014; v1 submitted 8 August, 2013; originally announced August 2013.

High-Precision Measurement of the 19Ne Half-Life and Implications for Right-Handed Weak Currents

Authors: S. Triambak, P. Finlay, C. S. Sumithrarachchi, G. Hackman, G. C. Ball, P. E. Garrett, C. E. Svensson, D. S. Cross, A. B. Garnsworthy, R. Kshetri, J. N. Orce, M. R. Pearson, E. R. Tardiff, H. Al-Falou, R. A. E. Austin, R. Churchman, M. K. Djongolov, R. D'Entremont, C. Kierans, L. Milovanovic, S. O'Hagan, S. Reeve, S. K. L. Sjue, S. J. Williams

Abstract: We report a precise determination of the 19Ne half-life to be $T_{1/2} = 17.262 \pm 0.007$ s. This result disagrees with the most recent precision measurements and is important for placing bounds on predicted right-handed interactions that are absent in the current Standard Model. We are able to identify and disentangle two competing systematic effects that influence the accuracy of such measureme… ▽ More We report a precise determination of the 19Ne half-life to be $T_{1/2} = 17.262 \pm 0.007$ s. This result disagrees with the most recent precision measurements and is important for placing bounds on predicted right-handed interactions that are absent in the current Standard Model. We are able to identify and disentangle two competing systematic effects that influence the accuracy of such measurements. Our findings prompt a reassessment of results from previous high-precision lifetime measurements that used similar equipment and methods. △ Less

Submitted 26 June, 2012; v1 submitted 25 June, 2012; originally announced June 2012.

Comments: 5 pages and 5 figures. Paper accepted for publication in Phys. Rev. Lett