-
Importance of Tuning Hyperparameters of Machine Learning Algorithms
Authors:
Hilde J. P. Weerts,
Andreas C. Mueller,
Joaquin Vanschoren
Abstract:
The performance of many machine learning algorithms depends on their hyperparameter settings. The goal of this study is to determine whether it is important to tune a hyperparameter or whether it can be safely set to a default value. We present a methodology to determine the importance of tuning a hyperparameter based on a non-inferiority test and tuning risk: the performance loss that is incurred…
▽ More
The performance of many machine learning algorithms depends on their hyperparameter settings. The goal of this study is to determine whether it is important to tune a hyperparameter or whether it can be safely set to a default value. We present a methodology to determine the importance of tuning a hyperparameter based on a non-inferiority test and tuning risk: the performance loss that is incurred when a hyperparameter is not tuned, but set to a default value. Because our methods require the notion of a default parameter, we present a simple procedure that can be used to determine reasonable default parameters. We apply our methods in a benchmark study using 59 datasets from OpenML. Our results show that leaving particular hyperparameters at their default value is non-inferior to tuning these hyperparameters. In some cases, leaving the hyperparameter at its default value even outperforms tuning it using a search procedure with a limited number of iterations.
△ Less
Submitted 15 July, 2020;
originally announced July 2020.
-
Learning a Loopy Model For Semantic Segmentation Exactly
Authors:
Andreas Christian Mueller,
Sven Behnke
Abstract:
Learning structured models using maximum margin techniques has become an indispensable tool for com- puter vision researchers, as many computer vision applications can be cast naturally as an image labeling problem. Pixel-based or superpixel-based conditional random fields are particularly popular examples. Typ- ically, neighborhood graphs, which contain a large number of cycles, are used. As exac…
▽ More
Learning structured models using maximum margin techniques has become an indispensable tool for com- puter vision researchers, as many computer vision applications can be cast naturally as an image labeling problem. Pixel-based or superpixel-based conditional random fields are particularly popular examples. Typ- ically, neighborhood graphs, which contain a large number of cycles, are used. As exact inference in loopy graphs is NP-hard in general, learning these models without approximations is usually deemed infeasible. In this work we show that, despite the theoretical hardness, it is possible to learn loopy models exactly in practical applications. To this end, we analyze the use of multiple approximate inference techniques together with cutting plane training of structural SVMs. We show that our proposed method yields exact solutions with an optimality guarantees in a computer vision application, for little additional computational cost. We also propose a dynamic caching scheme to accelerate training further, yielding runtimes that are comparable with approximate methods. We hope that this insight can lead to a reconsideration of the tractability of loopy models in computer vision.
△ Less
Submitted 16 September, 2013;
originally announced September 2013.
-
Transmutation of Nuclear Waste and the future MYRRHA Demonstrator
Authors:
Alex C. Mueller
Abstract:
While a considerable and world-wide growth of the nuclear share in the global energy mix is desirable for many reasons, there are also, in particular in the "old world" major objections. These are both concerns about safety, in particular in the wake of the Fukushima nuclear accident and concerns about the long-term burden that is constituted by the radiotoxic waste from the spent fuel. With regar…
▽ More
While a considerable and world-wide growth of the nuclear share in the global energy mix is desirable for many reasons, there are also, in particular in the "old world" major objections. These are both concerns about safety, in particular in the wake of the Fukushima nuclear accident and concerns about the long-term burden that is constituted by the radiotoxic waste from the spent fuel. With regard to the second topic, the present contribution will outline the concept of Partitioning & Transmutation (P&T), as scientific and technological answer. Deployment of P&T may use dedicated "Transmuter" or "Burner" reactors, using a fast neutron spectrum. For the transmutation of waste with a large content (up to 50%) of (very long-lived) Minor Actinides, a sub-critical reactor, using an external neutron source is a most attractive solution. It is constituted by coupling a proton accelerator, a spallation target and a subcritical core. This promising new technology is named ADS, for accelerator-driven system. The present paper aims at a short introduction into the field that has been characterized by a high collaborative activity during the last decade in Europe, in order to focus, in its later part, on the MYRRHA project as the European ADS technology demonstrator.
△ Less
Submitted 16 October, 2012;
originally announced October 2012.
-
Low Energy States of $^{81}_{31} Ga_{50}$ : Elements on the Doubly-Magic Nature of $^{78}$Ni
Authors:
David Verney,
C. Bourgeois,
C. Donzaud,
S. Essabaa,
S. Gales,
L. Gaudefroy,
D. Guillemaud-Mueller,
F. Hammache,
F. Ibrahim,
C. Lau,
F. Le Blanc,
A. C. Mueller,
O. Perru,
F. Pougheon,
B. Roussiere,
J. Sauvage,
O. Sorlin,
D. Verney
Abstract:
Excited levels were attributed to $^{81}_{31}$Ga$_{50}$ for the first time which were fed in the $β$-decay of its mother nucleus $^{81}$Zn produced in the fission of $^{nat}$U using the ISOL technique. We show that the structure of this nucleus is consistent with that of the less exotic proton-deficient N=50 isotones within the assumption of strong proton Z=28 and neutron N=50 effective shell ef…
▽ More
Excited levels were attributed to $^{81}_{31}$Ga$_{50}$ for the first time which were fed in the $β$-decay of its mother nucleus $^{81}$Zn produced in the fission of $^{nat}$U using the ISOL technique. We show that the structure of this nucleus is consistent with that of the less exotic proton-deficient N=50 isotones within the assumption of strong proton Z=28 and neutron N=50 effective shell effects.
△ Less
Submitted 26 January, 2007;
originally announced January 2007.
-
Study of the N=50 major shell effect close to $^{78}$Ni : First evidence of a weak coupling structure in $^{83}\_{32}$Ge$\_{51}$ and three-proton configuration states in $^{81}\_{31}$Ga$\_{50}$
Authors:
D. Verney,
F. Ibrahim,
O. Perru,
O. Bajeat,
C. Bourgeois,
M. Ducourtieux,
C. Donzaud,
S. Essabaa,
S. Gales,
L. Gaudefroy,
D. Guillemaud-Mueller,
F. Hammache,
C. Lau,
H. Lefort,
F. Le Blanc,
A. C. Mueller,
F. Pougheon,
B. Roussiere,
J. Sauvage,
O. Sorlin
Abstract:
New levels were attributed to $^{81}\_{31}$Ga$\_{50}$ and $^{83}\_{32}$Ge$\_{51}$ which were fed by the $β$-decay of their respective mother nuclei $^{81}\_{30}$Zn$\_{51}$ and $^{83}\_{31}$Ga$\_{52}$ produced by fission at the "PARRNe" ISOL set-up installed at the Tandem accelerator of the Institut de Physique Nucléaire, Orsay. We show that the low energy structure of $^{81}\_{31}$Ga$\_{50}$ and…
▽ More
New levels were attributed to $^{81}\_{31}$Ga$\_{50}$ and $^{83}\_{32}$Ge$\_{51}$ which were fed by the $β$-decay of their respective mother nuclei $^{81}\_{30}$Zn$\_{51}$ and $^{83}\_{31}$Ga$\_{52}$ produced by fission at the "PARRNe" ISOL set-up installed at the Tandem accelerator of the Institut de Physique Nucléaire, Orsay. We show that the low energy structure of $^{81}\_{31}$Ga$\_{50}$ and $^{83}\_{32}$Ge$\_{51}$ can easily be explained within the natural hypothesis of a strong energy gap at N=50 and a doubly-magic character for $^{78}$Ni.
△ Less
Submitted 6 October, 2006;
originally announced October 2006.
-
Crossing the Dripline to 11N Using Elastic Resonance Scattering
Authors:
K. Markenroth,
L. Axelsson,
S. Baxter,
M. J. G. Borge,
C. Donzaud,
S. Fayans,
H. O. U. Fynbo,
V. Z. Goldberg,
S. Grevy,
D. Guillemaud-Mueller,
B. Jonson,
K. -M. Kallman,
S. Leenhardt,
M. Lewitowicz,
T. Lonnroth,
P. Manngard,
I. Martel,
A. C. Mueller,
I. Mukha,
T. Nilsson,
G. Nyman,
N. A. Orr,
K. Riisager,
G. V. Rogachev,
M. -G. Saint-Laurent
, et al. (11 additional authors not shown)
Abstract:
The level structure of the unbound nucleus 11N has been studied by 10C+p elastic resonance scattering in inverse geometry with the LISE3 spectrometer at GANIL, using a 10C beam with an energy of 9.0 MeV/u. An additional measurement was done at the A1200 spectrometer at MSU. The excitation function above the 10C+p threshold has been determined up to 5 MeV. A potential-model analysis revealed thre…
▽ More
The level structure of the unbound nucleus 11N has been studied by 10C+p elastic resonance scattering in inverse geometry with the LISE3 spectrometer at GANIL, using a 10C beam with an energy of 9.0 MeV/u. An additional measurement was done at the A1200 spectrometer at MSU. The excitation function above the 10C+p threshold has been determined up to 5 MeV. A potential-model analysis revealed three resonance states at energies 1.27 (+0.18-0.05) MeV (Gamma=1.44 +-0.2 MeV), 2.01(+0.15-0.05) MeV, (Gamma=0.84 +-$0.2 MeV) and 3.75(+-0.05) MeV, (Gamma=0.60 +-0.05 MeV) with the spin-parity assignments I(pi) =1/2+, 1/2- and 5/2+, respectively. Hence, 11N is shown to have a ground state parity inversion completely analogous to its mirror partner, 11Be. A narrow resonance in the excitation function at 4.33 (+-0.05) MeV was also observed and assigned spin-parity 3/2-.
△ Less
Submitted 21 June, 2000;
originally announced June 2000.
-
The Halo of 14Be
Authors:
M. Labiche,
N. A. Orr,
F. M. Marques,
J. C. Angelique,
L. Axelsson,
B. Benoit,
U. C. Bergmann,
M. J. G. Borge,
W. N. Catford,
S. P. G. Chappell,
N. M. Clarke,
G. Costa,
N. Curtis,
A. D'Arrigo,
E. de Goes Brennand,
O. Dorvaux,
G. Fazio,
M. Freer,
B. R. Fulton,
G. Giardina,
S. Grevy,
D. Guillemaud-Mueller,
F. Hanappe,
B. Heusch K. L. Jones,
B. Jonson
, et al. (17 additional authors not shown)
Abstract:
The two-neutron halo nucleus 14Be has been investigated in a kinematically complete measurement of the fragments (12Be and neutrons) produced in dissociation at 35 MeV/nucleon on C and Pb targets. Two-neutron removal cross-sections, neutron angular distributions and invariant mass spectra characteristic of a halo were observed and the electromagnetic (EMD) contributions deduced. Comparison with…
▽ More
The two-neutron halo nucleus 14Be has been investigated in a kinematically complete measurement of the fragments (12Be and neutrons) produced in dissociation at 35 MeV/nucleon on C and Pb targets. Two-neutron removal cross-sections, neutron angular distributions and invariant mass spectra characteristic of a halo were observed and the electromagnetic (EMD) contributions deduced. Comparison with three-body model predictions indicate that the halo wavefunction contains a large 2s1/2^2 admixture. The EMD invariant mass spectrum exhibited a relatively narrow structure near threshold (Edecay=1.8+/-0.1 MeV, Gamma = 0.8+/-0.4 MeV) consistent with a soft-dipole excitation.
△ Less
Submitted 7 June, 2000;
originally announced June 2000.
