Showing 1–2 of 2 results for author: Taube, A
-
Efficient hyperparameter optimization by way of PAC-Bayes bound minimization
Authors:
John J. Cherian,
Andrew G. Taube,
Robert T. McGibbon,
Panagiotis Angelikopoulos,
Guy Blanc,
Michael Snarski,
Daniel D. Richman,
John L. Klepeis,
David E. Shaw
Abstract:
Identifying optimal values for a high-dimensional set of hyperparameters is a problem that has received growing attention given its importance to large-scale machine learning applications such as neural architecture search. Recently developed optimization methods can be used to select thousands or even millions of hyperparameters. Such methods often yield overfit models, however, leading to poor p…
▽ More
Identifying optimal values for a high-dimensional set of hyperparameters is a problem that has received growing attention given its importance to large-scale machine learning applications such as neural architecture search. Recently developed optimization methods can be used to select thousands or even millions of hyperparameters. Such methods often yield overfit models, however, leading to poor performance on unseen data. We argue that this overfitting results from using the standard hyperparameter optimization objective function. Here we present an alternative objective that is equivalent to a Probably Approximately Correct-Bayes (PAC-Bayes) bound on the expected out-of-sample error. We then devise an efficient gradient-based algorithm to minimize this objective; the proposed method has asymptotic space and time complexity equal to or better than other gradient-based hyperparameter optimization methods. We show that this new method significantly reduces out-of-sample error when applied to hyperparameter optimization problems known to be prone to overfitting.
△ Less
Submitted 14 August, 2020;
originally announced August 2020.
-
Temperature-dependent nonlinear phonon shifts in a supported MoS2 monolayer
Authors:
Andrzej Taube,
Jarosław Judek,
Cezariusz Jastrzębski,
Anna Duzynska,
Krzysztof Świtkowski,
Mariusz Zdrojek
Abstract:
We report Raman spectra measurements on a MoS2 monolayer supported on SiO2 as a function of temperature. Unlike in previous studies, the positions of the two main Raman modes, E2g1 and A1g exhibited nonlinear temperature dependence. Temperature dependence of phonon shifts and widths is explained by optical phonon decay process into two acoustic phonons. On the basis of Raman measurements, local te…
▽ More
We report Raman spectra measurements on a MoS2 monolayer supported on SiO2 as a function of temperature. Unlike in previous studies, the positions of the two main Raman modes, E2g1 and A1g exhibited nonlinear temperature dependence. Temperature dependence of phonon shifts and widths is explained by optical phonon decay process into two acoustic phonons. On the basis of Raman measurements, local temperature change under laser heating power at different global temperatures is derived. Obtained results contribute to our understanding of the thermal properties of two-dimensional atomic crystals and can help to solve the problem of heat dissipation, which is crucial for use in the next generation of nanoelectronic devices.
△ Less
Submitted 12 June, 2014;
originally announced June 2014.
