Skip to main content

Showing 1–24 of 24 results for author: Reeve, W

.
  1. arXiv:2405.18091  [pdf, ps, other

    math.ST cs.LG

    An adaptive transfer learning perspective on classification in non-stationary environments

    Authors: Henry W J Reeve

    Abstract: We consider a semi-supervised classification problem with non-stationary label-shift in which we observe a labelled data set followed by a sequence of unlabelled covariate vectors in which the marginal probabilities of the class labels may change over time. Our objective is to predict the corresponding class-label for each covariate vector, without ever observing the ground-truth labels, beyond th… ▽ More

    Submitted 28 May, 2024; originally announced May 2024.

  2. arXiv:2403.16651  [pdf, ps, other

    math.PR math.ST

    A short proof of the Dvoretzky--Kiefer--Wolfowitz--Massart inequality

    Authors: Henry W J Reeve

    Abstract: The Dvoretzky--Kiefer--Wolfowitz--Massart inequality gives a sub-Gaussian tail bound on the supremum norm distance between the empirical distribution function of a random sample and its population counterpart. We provide a short proof of a result that improves the existing bound in two respects. First, our one-sided bound holds without any restrictions on the failure probability, thereby verifying… ▽ More

    Submitted 25 March, 2024; originally announced March 2024.

    MSC Class: 62G30

  3. arXiv:2305.04852  [pdf, other

    math.ST stat.ME

    Isotonic subgroup selection

    Authors: Manuel M. Müller, Henry W. J. Reeve, Timothy I. Cannings, Richard J. Samworth

    Abstract: Given a sample of covariate-response pairs, we consider the subgroup selection problem of identifying a subset of the covariate domain where the regression function exceeds a pre-determined threshold. We introduce a computationally-feasible approach for subgroup selection in the context of multivariate isotonic regression based on martingale tests and multiple testing procedures for logically-stru… ▽ More

    Submitted 28 June, 2023; v1 submitted 8 May, 2023; originally announced May 2023.

    Comments: 69 pages, 20 figures

    MSC Class: 62G08; 62H15

  4. Scattering Parameter Measurements of the Long Wavelength Array Antenna and Front End Electronics

    Authors: Christopher DiLullo, Whitham D. Reeve, Brian C. Hicks, Jayce Dowell

    Abstract: We present recent 2-port vector network analyzer (VNA) measurements of the complete set of scattering parameters for the antenna used within the Long Wavelength Array (LWA) and the associated front end electronics (FEEs). Full scattering parameter measurements of the antenna yield not only the reflection coefficient for each polarization, S11 and S22, but also the coupling between polarizations, S… ▽ More

    Submitted 26 March, 2023; originally announced March 2023.

    Comments: 16 pages, 12 figures, Accepted for publication in Publications of the Astronomical Society of the Pacific

  5. arXiv:2302.10655  [pdf, other

    stat.ML cs.LG stat.ME

    Density Ratio Estimation and Neyman Pearson Classification with Missing Data

    Authors: Josh Givens, Song Liu, Henry W J Reeve

    Abstract: Density Ratio Estimation (DRE) is an important machine learning technique with many downstream applications. We consider the challenge of DRE with missing not at random (MNAR) data. In this setting, we show that using standard DRE methods leads to biased results while our proposal (M-KLIEP), an adaptation of the popular DRE procedure KLIEP, restores consistency. Moreover, we provide finite sample… ▽ More

    Submitted 21 February, 2023; originally announced February 2023.

    Comments: 40 pages, 11 Figures. To be published in proceedings for AISTAT 2023

  6. arXiv:2201.07828  [pdf, ps, other

    astro-ph.SR astro-ph.IM

    First Solar Radio Burst Observations by the Mexican Array Radio Telescope (MEXART) at 140 MHz

    Authors: E. Huipe-Domratcheva, V. De la Luz, G. A. Casillas-Perez, J. C. Mejia-Ambriz, E. Perez-Leon, J. A. Gonzalez-Esparza, C. Monstein, W. Reeve

    Abstract: The National Laboratory of Space Weather in Mexico (Laboratorio Nacional de ClimaEspacial: LANCE) coordinates instrumentation for monitoring the space-weatherimpact over Mexico. Two of these instruments are the Mexican Array Radio Telescope(MEXART) and Compound Astronomical Low frequency Low cost Instrument for Spectroscopy and Transportable Observatory(CALLISTO) station from the e-CALLISTO networ… ▽ More

    Submitted 19 January, 2022; originally announced January 2022.

    Journal ref: Sol Phys 297, 9 (2022)

  7. arXiv:2109.09427  [pdf, other

    cs.LG

    Asymptotic Optimality for Decentralised Bandits

    Authors: Conor Newton, Ayalvadi Ganesh, Henry W. J. Reeve

    Abstract: We consider a large number of agents collaborating on a multi-armed bandit problem with a large number of arms. The goal is to minimise the regret of each agent in a communication-constrained setting. We present a decentralised algorithm which builds upon and improves the Gossip-Insert-Eliminate method of Chawla et al. arxiv:2001.05452. We provide a theoretical analysis of the regret incurred whic… ▽ More

    Submitted 20 September, 2021; originally announced September 2021.

  8. arXiv:2109.01077  [pdf, ps, other

    math.ST cs.LG stat.ME stat.ML

    Optimal subgroup selection

    Authors: Henry W. J. Reeve, Timothy I. Cannings, Richard J. Samworth

    Abstract: In clinical trials and other applications, we often see regions of the feature space that appear to exhibit interesting behaviour, but it is unclear whether these observed phenomena are reflected at the population level. Focusing on a regression setting, we consider the subgroup selection challenge of identifying a region of the feature space on which the regression function exceeds a pre-determin… ▽ More

    Submitted 20 September, 2023; v1 submitted 2 September, 2021; originally announced September 2021.

    Comments: 65 pages, 2 figures, to appear in the Annals of Statistics

    MSC Class: 62-XX; 62G08; 62Gxx; 62C20

  9. arXiv:2106.04455  [pdf, other

    stat.ML cs.LG math.ST stat.ME

    Adaptive transfer learning

    Authors: Henry W. J. Reeve, Timothy I. Cannings, Richard J. Samworth

    Abstract: In transfer learning, we wish to make inference about a target population when we have access to data both from the distribution itself, and from a different but related source distribution. We introduce a flexible framework for transfer learning in the context of binary classification, allowing for covariate-dependent relationships between the source and target distributions that are not required… ▽ More

    Submitted 8 June, 2021; originally announced June 2021.

    MSC Class: 62G05

  10. arXiv:2106.01092  [pdf, ps, other

    cs.LG math.ST

    Statistical optimality conditions for compressive ensembles

    Authors: Henry W. J. Reeve, Ata Kaban

    Abstract: We present a framework for the theoretical analysis of ensembles of low-complexity empirical risk minimisers trained on independent random compressions of high-dimensional data. First we introduce a general distribution-dependent upper-bound on the excess risk, framed in terms of a natural notion of compressibility. This bound is independent of the dimension of the original data representation, an… ▽ More

    Submitted 2 June, 2021; originally announced June 2021.

    MSC Class: 62-08

  11. arXiv:2002.09769  [pdf, ps, other

    stat.ML cs.LG

    Optimistic bounds for multi-output prediction

    Authors: Henry WJ Reeve, Ata Kaban

    Abstract: We investigate the challenge of multi-output learning, where the goal is to learn a vector-valued function based on a supervised data set. This includes a range of important problems in Machine Learning including multi-target regression, multi-class classification and multi-label classification. We begin our analysis by introducing the self-bounding Lipschitz condition for multi-output loss functi… ▽ More

    Submitted 22 February, 2020; originally announced February 2020.

  12. arXiv:1906.04542  [pdf, other

    cs.LG stat.ML

    Fast Rates for a kNN Classifier Robust to Unknown Asymmetric Label Noise

    Authors: Henry W. J. Reeve, Ata Kaban

    Abstract: We consider classification in the presence of class-dependent asymmetric label noise with unknown noise probabilities. In this setting, identifiability conditions are known, but additional assumptions were shown to be required for finite sample rates, and so far only the parametric rate has been obtained. Assuming these identifiability conditions, together with a measure-smoothness condition on th… ▽ More

    Submitted 11 June, 2019; originally announced June 2019.

    Comments: ICML 2019

  13. arXiv:1902.05627  [pdf, other

    stat.ML cs.LG

    Classification with unknown class-conditional label noise on non-compact feature spaces

    Authors: Henry W J Reeve, Ata Kaban

    Abstract: We investigate the problem of classification in the presence of unknown class-conditional label noise in which the labels observed by the learner have been corrupted with some unknown class dependent probability. In order to obtain finite sample rates, previous approaches to classification with unknown class-conditional label noise have required that the regression function is close to its extrema… ▽ More

    Submitted 9 June, 2019; v1 submitted 14 February, 2019; originally announced February 2019.

  14. arXiv:1803.00316  [pdf, other

    cs.LG stat.ML

    The K-Nearest Neighbour UCB algorithm for multi-armed bandits with covariates

    Authors: Henry WJ Reeve, Joe Mellor, Gavin Brown

    Abstract: In this paper we propose and explore the k-Nearest Neighbour UCB algorithm for multi-armed bandits with covariates. We focus on a setting where the covariates are supported on a metric space of low intrinsic dimension, such as a manifold embedded within a high dimensional ambient feature space. The algorithm is conceptually simple and straightforward to implement. The k-Nearest Neighbour UCB algor… ▽ More

    Submitted 1 March, 2018; originally announced March 2018.

    Comments: To be presented at ALT 2018

    Journal ref: Algorithmic Learning Theory 2018

  15. arXiv:1803.00314  [pdf, other

    cs.LG

    Diversity and degrees of freedom in regression ensembles

    Authors: Henry WJ Reeve, Gavin Brown

    Abstract: Ensemble methods are a cornerstone of modern machine learning. The performance of an ensemble depends crucially upon the level of diversity between its constituent learners. This paper establishes a connection between diversity and degrees of freedom (i.e. the capacity of the model), showing that diversity may be viewed as a form of inverse regularisation. This is achieved by focusing on a previou… ▽ More

    Submitted 1 March, 2018; originally announced March 2018.

    Comments: Neurocomputing 2018

    Journal ref: Neurocomputing 2018

  16. arXiv:1803.00310  [pdf, other

    cs.LG stat.ML

    Minimax rates for cost-sensitive learning on manifolds with approximate nearest neighbours

    Authors: Henry WJ Reeve, Gavin Brown

    Abstract: We study the approximate nearest neighbour method for cost-sensitive classification on low-dimensional manifolds embedded within a high-dimensional feature space. We determine the minimax learning rates for distributions on a smooth manifold, in a cost-sensitive setting. This generalises a classic result of Audibert and Tsybakov. Building upon recent work of Chaudhuri and Dasgupta we prove that th… ▽ More

    Submitted 1 March, 2018; originally announced March 2018.

    Comments: Published in ALT 2017

    Journal ref: Algorithmic Learning Theory 2017

  17. arXiv:1511.07340  [pdf, other

    cs.LG

    Modular Autoencoders for Ensemble Feature Extraction

    Authors: Henry W J Reeve, Gavin Brown

    Abstract: We introduce the concept of a Modular Autoencoder (MAE), capable of learning a set of diverse but complementary representations from unlabelled data, that can later be used for supervised tasks. The learning of the representations is controlled by a trade off parameter, and we show on six benchmark datasets the optimum lies between two extremes: a set of smaller, independent autoencoders each with… ▽ More

    Submitted 23 November, 2015; originally announced November 2015.

    Comments: 18 pages, 8 figures, to appear in a special issue of The Journal Of Machine Learning Research (vol.44, Dec 2015)

  18. A Frostman type lemma for sets with large intersections, and an application to Diophantine approximation

    Authors: Tomas Persson, Henry W. J. Reeve

    Abstract: We consider classes $\mathscr{G}^s ([0,1])$ of subsets of $[0,1]$, originally introduced by Falconer, that are closed under countable intersections, and such that every set in the class has Hausdorff dimension at least $s$. We provide a Frostman type lemma to determine if a limsup-set is in such a class. Suppose $E = \limsup E_n \subset [0,1]$, and that $μ_n$ are probability measures with support… ▽ More

    Submitted 11 September, 2017; v1 submitted 5 February, 2013; originally announced February 2013.

    Comments: 1+20 pages; Erratum added

    MSC Class: 11J83; 11K55; 28A78; 28A80

    Journal ref: Proceedings of the Edinburgh Mathematical Society, Volume 58, Issue 02, June 2015, 521--542

  19. Multifractal analysis of Birkhoff averages for typical infinitely generated self-affine sets

    Authors: Antti Käenmäki, Henry WJ Reeve

    Abstract: We develop a thermodynamic formalism for quasi-multiplicative potentials on a countable symbolic space and apply these results to the dimension theory of infinitely generated self-affine sets. The first application is a generalisation of Falconer's dimension formula to include typical infinitely generated self-affine sets and show the existence of an ergodic invariant measure of full dimension whe… ▽ More

    Submitted 23 December, 2012; originally announced December 2012.

    MSC Class: Primary 28A80; Secondary 37D35

    Journal ref: J. Fractal Geom., 1 (2014), no. 1, 83-152

  20. On the Diophantine properties of lambda-expansions

    Authors: Tomas Persson, Henry W. J. Reeve

    Abstract: For $λ\in (1/2, 1)$ and $α$, we consider sets of numbers $x$ such that for infinitely many $n$, $x$ is $2^{-αn}$-close to some $\sum_{i=1}^n ω_i λ^i$, where $ω_i \in \{0,1\}$. These sets are in Falconer's intersection classes for Hausdorff dimension $s$ for some $s$ such that $- \frac{1}α \frac{\log λ}{\log 2} \leq s \leq \frac{1}α$. We show that for almost all $λ\in (1/2, 2/3)$, the upper bound o… ▽ More

    Submitted 22 February, 2012; originally announced February 2012.

    Comments: 21 pages

    MSC Class: 11J83; 28A78

  21. arXiv:1107.4736  [pdf, other

    math.DS

    Shrinking Targets for Countable Markov Maps

    Authors: Henry WJ Reeve

    Abstract: Let $T$ be an expanding Markov map with a countable number of inverse branches and a repeller $Λ$ contained within the unit interval. Given $α\in \R_+$ we consider the set of points $x \in Λ$ for which $T^n(x)$ hits a shrinking ball of radius $e^{-nα}$ around $y$ for infinitely many iterates $n$. Let $s(α)$ denote the infimal value of $s$ for which the pressure of the potential $-s\log|T'|$ is bel… ▽ More

    Submitted 12 September, 2011; v1 submitted 24 July, 2011; originally announced July 2011.

    Comments: 25 pages

  22. arXiv:1105.3137  [pdf, other

    math.DS

    Infinite Non-Conformal Iterated Function Systems

    Authors: Henry WJ Reeve

    Abstract: We consider a generalisation of the self-affine iterated function systems of Lalley and Gatzouras by allowing for a countable infinity of non-conformal contractions. It is shown that the Hausdorff dimension of the limit set is equal to the supremum of the dimensions of compactly supported ergodic measures. In addition we consider the multifractal analysis for countable families of potentials. We o… ▽ More

    Submitted 7 June, 2011; v1 submitted 16 May, 2011; originally announced May 2011.

    Comments: 37 pages

  23. arXiv:1008.0301  [pdf, other

    math.DS

    Multifractal analysis for Birkhoff averages on Lalley-Gatzouras repellers

    Authors: Henry WJ Reeve

    Abstract: We consider the multifractal analysis for Birkhoff averages of continuous potentials on a class of non-conformal repellers corresponding to the self-affine limit sets studied by Lalley and Gatzouras. A conditional variational principle is given for the Hausdorff dimension of the set of points for which the Birkhoff averages converge to a given value. This extends a result of Barral and Mensi to ce… ▽ More

    Submitted 24 March, 2011; v1 submitted 2 August, 2010; originally announced August 2010.

    Comments: 22 pages, 1 figure

    Journal ref: Fund. Math. 212 (2011), 71-93

  24. arXiv:1006.4086  [pdf, other

    math.DS

    The packing spectrum for Birkhoff averages on a self-affine repeller

    Authors: Henry WJ Reeve

    Abstract: We consider the multifractal analysis for Birkhoff averages of continuous potentials on a self-affine Sierpiński sponge. In particular, we give a variational principal for the packing dimension of the level sets. Furthermore, we prove that the packing spectrum is concave and continuous. We give a sufficient condition for the packing spectrum to be real analytic, but show that for general Hölder co… ▽ More

    Submitted 24 March, 2011; v1 submitted 21 June, 2010; originally announced June 2010.

    Comments: 25 pages, 2 figures; to appear in Ergodic Theory & Dynamical Systems