-
Experimental Investigation and Evaluation of Model-based Hyperparameter Optimization
Authors:
Eva Bartz,
Martin Zaefferer,
Olaf Mersmann,
Thomas Bartz-Beielstein
Abstract:
Machine learning algorithms such as random forests or xgboost are gaining more importance and are increasingly incorporated into production processes in order to enable comprehensive digitization and, if possible, automation of processes. Hyperparameters of these algorithms used have to be set appropriately, which can be referred to as hyperparameter tuning or optimization. Based on the concept of…
▽ More
Machine learning algorithms such as random forests or xgboost are gaining more importance and are increasingly incorporated into production processes in order to enable comprehensive digitization and, if possible, automation of processes. Hyperparameters of these algorithms used have to be set appropriately, which can be referred to as hyperparameter tuning or optimization. Based on the concept of tunability, this article presents an overview of theoretical and practical results for popular machine learning algorithms. This overview is accompanied by an experimental analysis of 30 hyperparameters from six relevant machine learning algorithms. In particular, it provides (i) a survey of important hyperparameters, (ii) two parameter tuning studies, and (iii) one extensive global parameter tuning study, as well as (iv) a new way, based on consensus ranking, to analyze results from multiple algorithms. The R package mlr is used as a uniform interface to the machine learning models. The R package SPOT is used to perform the actual tuning (optimization). All additional code is provided together with this paper.
△ Less
Submitted 19 July, 2021;
originally announced July 2021.
-
Hospital Capacity Planning Using Discrete Event Simulation Under Special Consideration of the COVID-19 Pandemic
Authors:
Thomas Bartz-Beielstein,
Frederik Rehbach,
Olaf Mersmann,
Eva Bartz
Abstract:
We present a resource-planning tool for hospitals under special consideration of the COVID-19 pandemic, called babsim.hospital. It provides many advantages for crisis teams, e.g., comparison with their own local planning, simulation of local events, simulation of several scenarios (worst / best case). There are benefits for medical professionals, e.g, analysis of the pandemic at local, regional, s…
▽ More
We present a resource-planning tool for hospitals under special consideration of the COVID-19 pandemic, called babsim.hospital. It provides many advantages for crisis teams, e.g., comparison with their own local planning, simulation of local events, simulation of several scenarios (worst / best case). There are benefits for medical professionals, e.g, analysis of the pandemic at local, regional, state and federal level, the consideration of special risk groups, tools for validating the length of stays and transition probabilities. Finally, there are potential advantages for administration, management, e.g., assessment of the situation of individual hospitals taking local events into account, consideration of relevant resources such as beds, ventilators, rooms, protective clothing, and personnel planning, e.g., medical and nursing staff. babsim.hospital combines simulation, optimization, statistics, and artificial intelligence processes in a very efficient way. The core is a discrete, event-based simulation model.
△ Less
Submitted 13 December, 2020;
originally announced December 2020.
-
Optimization of High-dimensional Simulation Models Using Synthetic Data
Authors:
Thomas Bartz-Beielstein,
Eva Bartz,
Frederik Rehbach,
Olaf Mersmann
Abstract:
Simulation models are valuable tools for resource usage estimation and capacity planning. In many situations, reliable data is not available. We introduce the BuB simulator, which requires only the specification of plausible intervals for the simulation parameters. By performing a surrogate-model based optimization, improved simulation model parameters can be determined. Furthermore, a detailed st…
▽ More
Simulation models are valuable tools for resource usage estimation and capacity planning. In many situations, reliable data is not available. We introduce the BuB simulator, which requires only the specification of plausible intervals for the simulation parameters. By performing a surrogate-model based optimization, improved simulation model parameters can be determined. Furthermore, a detailed statistical analysis can be performed, which allows deep insights into the most important model parameters and their interactions. This information can be used to screen the parameters that should be further investigated. To exemplify our approach, a capacity and resource planning task for a hospital was simulated and optimized. The study explicitly covers difficulties caused by the COVID-19 pandemic. It can be shown, that even if only limited real-world data is available, the BuB simulator can be beneficially used to consider worst- and best-case scenarios. The BuB simulator can be extended in many ways, e.g., by adding further resources (personal protection equipment, staff, pharmaceuticals) or by specifying several cohorts (based on age, health status, etc.).
Keywords: Synthetic data, discrete-event simulation, surrogate-model-based optimization, COVID-19, machine learning, artificial intelligence, hospital resource planning, prediction tool, capacity planning.
△ Less
Submitted 6 September, 2020;
originally announced September 2020.
-
FPGA-based tracking for the CMS Level-1 trigger using the tracklet algorithm
Authors:
E. Bartz,
G. Boudoul,
R. Bucci,
J. Chaves,
E. Clement,
D. Cranshaw,
S. Dutta,
Y. Gershtein,
R. Glein,
K. Hahn,
E. Halkiadakis,
M. Hildreth,
S. Kyriacou,
K. Lannon,
A. Lefeld,
Y. Liu,
E. MacDonald,
N. Pozzobon,
A. Ryd,
K. Salyer,
P. Shields,
L. Skinnari,
K. Stenson,
R. Stone,
C. Strohman
, et al. (9 additional authors not shown)
Abstract:
The high instantaneous luminosities expected following the upgrade of the Large Hadron Collider (LHC) to the High Luminosity LHC (HL-LHC) pose major experimental challenges for the CMS experiment. A central component to allow efficient operation under these conditions is the reconstruction of charged particle trajectories and their inclusion in the hardware-based trigger system. There are many cha…
▽ More
The high instantaneous luminosities expected following the upgrade of the Large Hadron Collider (LHC) to the High Luminosity LHC (HL-LHC) pose major experimental challenges for the CMS experiment. A central component to allow efficient operation under these conditions is the reconstruction of charged particle trajectories and their inclusion in the hardware-based trigger system. There are many challenges involved in achieving this: a large input data rate of about 20--40 Tb/s; processing a new batch of input data every 25 ns, each consisting of about 15,000 precise position measurements and rough transverse momentum measurements of particles ("stubs''); performing the pattern recognition on these stubs to find the trajectories; and producing the list of trajectory parameters within 4 $μ\,$s. This paper describes a proposed solution to this problem, specifically, it presents a novel approach to pattern recognition and charged particle trajectory reconstruction using an all-FPGA solution. The results of an end-to-end demonstrator system, based on Xilinx Virtex-7 FPGAs, that meets timing and performance requirements are presented along with a further improved, optimized version of the algorithm together with its corresponding expected performance.
△ Less
Submitted 6 July, 2020; v1 submitted 22 October, 2019;
originally announced October 2019.
-
FPGA-Based Tracklet Approach to Level-1 Track Finding at CMS for the HL-LHC
Authors:
Edward Bartz,
Jorge Chaves,
Yuri Gershtein,
Eva Halkiadakis,
Michael Hildreth,
Savvas Kyriacou,
Kevin Lannon,
Anthony Lefeld,
Anders Ryd,
Louise Skinnari,
Robert Stone,
Charles Strohman,
Zhengcheng Tao,
Brian Winer,
Peter Wittich,
Margaret Zientek
Abstract:
During the High Luminosity LHC, the CMS detector will need charged particle tracking at the hardware trigger level to maintain a manageable trigger rate and achieve its physics goals. The tracklet approach is a track-finding algorithm based on a road-search algorithm that has been implemented on commercially available FPGA technology. The tracklet algorithm has achieved high performance in track-f…
▽ More
During the High Luminosity LHC, the CMS detector will need charged particle tracking at the hardware trigger level to maintain a manageable trigger rate and achieve its physics goals. The tracklet approach is a track-finding algorithm based on a road-search algorithm that has been implemented on commercially available FPGA technology. The tracklet algorithm has achieved high performance in track-finding and completes tracking within 3.4 $μ$s on a Xilinx Virtex-7 FPGA. An overview of the algorithm and its implementation on an FPGA is given, results are shown from a demonstrator test stand and system performance studies are presented.
△ Less
Submitted 28 June, 2017;
originally announced June 2017.
-
Test Beam Performance Measurements for the Phase I Upgrade of the CMS Pixel Detector
Authors:
M. Dragicevic,
M. Friedl,
J. Hrubec,
H. Steininger,
A. Gädda,
J. Härkönen,
T. Lampén,
P. Luukka,
T. Peltola,
E. Tuominen,
E. Tuovinen,
A. Winkler,
P. Eerola,
T. Tuuva,
G. Baulieu,
G. Boudoul,
L. Caponetto,
C. Combaret,
D. Contardo,
T. Dupasquier,
G. Gallbit,
N. Lumb,
L. Mirabito,
S. Perries,
M. Vander Donckt
, et al. (462 additional authors not shown)
Abstract:
A new pixel detector for the CMS experiment was built in order to cope with the instantaneous luminosities anticipated for the Phase~I Upgrade of the LHC. The new CMS pixel detector provides four-hit tracking with a reduced material budget as well as new cooling and powering schemes. A new front-end readout chip mitigates buffering and bandwidth limitations, and allows operation at low comparator…
▽ More
A new pixel detector for the CMS experiment was built in order to cope with the instantaneous luminosities anticipated for the Phase~I Upgrade of the LHC. The new CMS pixel detector provides four-hit tracking with a reduced material budget as well as new cooling and powering schemes. A new front-end readout chip mitigates buffering and bandwidth limitations, and allows operation at low comparator thresholds. In this paper, comprehensive test beam studies are presented, which have been conducted to verify the design and to quantify the performance of the new detector assemblies in terms of tracking efficiency and spatial resolution. Under optimal conditions, the tracking efficiency is $99.95\pm0.05\,\%$, while the intrinsic spatial resolutions are $4.80\pm0.25\,μ\mathrm{m}$ and $7.99\pm0.21\,μ\mathrm{m}$ along the $100\,μ\mathrm{m}$ and $150\,μ\mathrm{m}$ pixel pitch, respectively. The findings are compared to a detailed Monte Carlo simulation of the pixel detector and good agreement is found.
△ Less
Submitted 1 June, 2017;
originally announced June 2017.
-
Observations of the Formation, Development, and Structure of a Current Sheet in an Eruptive Solar Flare
Authors:
Daniel B. Seaton,
Allison E. Bartz,
Jonathan M. Darnel
Abstract:
We present AIA observations of a structure we interpret as a current sheet associated with an X4.9 flare and coronal mass ejection that occurred on 2014~February~25 in NOAA Active Region 11990. We characterize the properties of the current sheet, finding that the sheet remains on the order of a few thousand km thick for much of the duration of the event and that its temperature generally ranged be…
▽ More
We present AIA observations of a structure we interpret as a current sheet associated with an X4.9 flare and coronal mass ejection that occurred on 2014~February~25 in NOAA Active Region 11990. We characterize the properties of the current sheet, finding that the sheet remains on the order of a few thousand km thick for much of the duration of the event and that its temperature generally ranged between $8-10\,\mathrm{MK}$. We also note the presence of other phenomena believed to be associated with magnetic reconnection in current sheets, including supra-arcade downflows and shrinking loops. We estimate that the rate of reconnection during the event was $M_{A} \approx 0.004-0.007$, a value consistent with model predictions. We conclude with a discussion of the implications of this event for reconnection-based eruption models.
△ Less
Submitted 21 October, 2016;
originally announced October 2016.
-
Trap** in irradiated p-on-n silicon sensors at fluences anticipated at the HL-LHC outer tracker
Authors:
W. Adam,
T. Bergauer,
M. Dragicevic,
M. Friedl,
R. Fruehwirth,
M. Hoch,
J. Hrubec,
M. Krammer,
W. Treberspurg,
W. Waltenberger,
S. Alderweireldt,
W. Beaumont,
X. Janssen,
S. Luyckx,
P. Van Mechelen,
N. Van Remortel,
A. Van Spilbeeck,
P. Barria,
C. Caillol,
B. Clerbaux,
G. De Lentdecker,
D. Dobur,
L. Favart,
A. Grebenyuk,
Th. Lenzi
, et al. (663 additional authors not shown)
Abstract:
The degradation of signal in silicon sensors is studied under conditions expected at the CERN High-Luminosity LHC. 200 $μ$m thick n-type silicon sensors are irradiated with protons of different energies to fluences of up to $3 \cdot 10^{15}$ neq/cm$^2$. Pulsed red laser light with a wavelength of 672 nm is used to generate electron-hole pairs in the sensors. The induced signals are used to determi…
▽ More
The degradation of signal in silicon sensors is studied under conditions expected at the CERN High-Luminosity LHC. 200 $μ$m thick n-type silicon sensors are irradiated with protons of different energies to fluences of up to $3 \cdot 10^{15}$ neq/cm$^2$. Pulsed red laser light with a wavelength of 672 nm is used to generate electron-hole pairs in the sensors. The induced signals are used to determine the charge collection efficiencies separately for electrons and holes drifting through the sensor. The effective trap** rates are extracted by comparing the results to simulation. The electric field is simulated using Synopsys device simulation assuming two effective defects. The generation and drift of charge carriers are simulated in an independent simulation based on PixelAV. The effective trap** rates are determined from the measured charge collection efficiencies and the simulated and measured time-resolved current pulses are compared. The effective trap** rates determined for both electrons and holes are about 50% smaller than those obtained using standard extrapolations of studies at low fluences and suggests an improved tracker performance over initial expectations.
△ Less
Submitted 7 May, 2015;
originally announced May 2015.
