-
Democratizing Uncertainty Quantification
Authors:
Linus Seelinger,
Anne Reinarz,
Mikkel B. Lykkegaard,
Robert Akers,
Amal M. A. Alghamdi,
David Aristoff,
Wolfgang Bangerth,
Jean Bénézech,
Matteo Diez,
Kurt Frey,
John D. Jakeman,
Jakob S. Jørgensen,
Ki-Tae Kim,
Massimiliano Martinelli,
Matthew Parno,
Riccardo Pellegrini,
Noemi Petra,
Nicolai A. B. Riis,
Katherine Rosenfeld,
Andrea Serani,
Lorenzo Tamellini,
Umberto Villa,
Tim J. Dodwell,
Robert Scheichl
Abstract:
Uncertainty Quantification (UQ) is vital to safety-critical model-based analyses, but the widespread adoption of sophisticated UQ methods is limited by technical complexity. In this paper, we introduce UM-Bridge (the UQ and Modeling Bridge), a high-level abstraction and software protocol that facilitates universal interoperability of UQ software with simulation codes. It breaks down the technical…
▽ More
Uncertainty Quantification (UQ) is vital to safety-critical model-based analyses, but the widespread adoption of sophisticated UQ methods is limited by technical complexity. In this paper, we introduce UM-Bridge (the UQ and Modeling Bridge), a high-level abstraction and software protocol that facilitates universal interoperability of UQ software with simulation codes. It breaks down the technical complexity of advanced UQ applications and enables separation of concerns between experts. UM-Bridge democratizes UQ by allowing effective interdisciplinary collaboration, accelerating the development of advanced UQ methods, and making it easy to perform UQ analyses from prototype to High Performance Computing (HPC) scale.
In addition, we present a library of ready-to-run UQ benchmark problems, all easily accessible through UM-Bridge. These benchmarks support UQ methodology research, enabling reproducible performance comparisons. We demonstrate UM-Bridge with several scientific applications, harnessing HPC resources even using UQ codes not designed with HPC support.
△ Less
Submitted 9 May, 2024; v1 submitted 21 February, 2024;
originally announced February 2024.
-
Analytical Benchmark Problems for Multifidelity Optimization Methods
Authors:
L. Mainini,
A. Serani,
M. P. Rumpfkeil,
E. Minisci,
D. Quagliarella,
H. Pehlivan,
S. Yildiz,
S. Ficini,
R. Pellegrini,
F. Di Fiore,
D. Bryson,
M. Nikbay,
M. Diez,
P. Beran
Abstract:
The paper presents a collection of analytical benchmark problems specifically selected to provide a set of stress tests for the assessment of multifidelity optimization methods. In addition, the paper discusses a comprehensive ensemble of metrics and criteria recommended for the rigorous and meaningful assessment of the performance of multifidelity strategies and algorithms.
The paper presents a collection of analytical benchmark problems specifically selected to provide a set of stress tests for the assessment of multifidelity optimization methods. In addition, the paper discusses a comprehensive ensemble of metrics and criteria recommended for the rigorous and meaningful assessment of the performance of multifidelity strategies and algorithms.
△ Less
Submitted 16 April, 2022;
originally announced April 2022.
-
Function-as-a-Service Benchmarking Framework
Authors:
Roland Pellegrini,
Igor Ivkic,
Markus Tauber
Abstract:
Cloud Service Providers deliver their products in form of 'as-a-Service', which are typically categorized by the level of abstraction. This approach hides the implementation details and shows only functionality to the user. However, the problem is that it is hard to measure the performance of Cloud services, because they behave like black boxes. Especially with Function-as-a-Service it is even mor…
▽ More
Cloud Service Providers deliver their products in form of 'as-a-Service', which are typically categorized by the level of abstraction. This approach hides the implementation details and shows only functionality to the user. However, the problem is that it is hard to measure the performance of Cloud services, because they behave like black boxes. Especially with Function-as-a-Service it is even more difficult because it completely hides server and infrastructure management from users by design. Cloud Service Prodivers usually restrict the maximum size of code, memory and runtime of Cloud Functions. Nevertheless, users need clarification if more ressources are needed to deliver services in high quality. In this regard, we present the architectural design of a new Function-as-a-Service benchmarking tool, which allows users to evaluate the performance of Cloud Functions. Furthermore, the capabilities of the framework are tested on an isolated platform with a specific workload. The results show that users are able to get insights into Function-as-a-Service environments. This, in turn, allows users to identify factors which may slow down or speed up the performance of Cloud Functions.
△ Less
Submitted 28 May, 2019;
originally announced May 2019.
-
Towards a Security-Aware Benchmarking Framework for Function-as-a-Service
Authors:
Roland Pellegrini,
Igor Ivkic,
Markus Tauber
Abstract:
In a world, where complexity increases on a daily basis the Function-as-a-Service (FaaS) cloud model seams to take countermeasures. In comparison to other cloud models, the fast evolving FaaS increasingly abstracts the underlying infrastructure and refocuses on the application logic. This trend brings huge benefits in application and performance but comes with difficulties for benchmarking cloud a…
▽ More
In a world, where complexity increases on a daily basis the Function-as-a-Service (FaaS) cloud model seams to take countermeasures. In comparison to other cloud models, the fast evolving FaaS increasingly abstracts the underlying infrastructure and refocuses on the application logic. This trend brings huge benefits in application and performance but comes with difficulties for benchmarking cloud applications. In this position paper, we present an initial investigation of benchmarking FaaS in close to reality production systems. Furthermore, we outline the architectural design including the necessary benchmarking metrics. We also discuss the possibility of using the proposed framework for identifying security vulnerabilities.
△ Less
Submitted 15 May, 2019;
originally announced May 2019.
