-
Containerisation for High Performance Computing Systems: Survey and Prospects
Authors:
Naweiluo Zhou,
Huan Zhou,
Dennis Hoppe
Abstract:
Containers improve the efficiency in application deployment and thus have been widely utilised on Cloud and lately in High Performance Computing (HPC) environments. Containers encapsulate complex programs with their dependencies in isolated environments making applications more compatible and portable. Often HPC systems have higher security levels compared to Cloud systems, which restrict users' a…
▽ More
Containers improve the efficiency in application deployment and thus have been widely utilised on Cloud and lately in High Performance Computing (HPC) environments. Containers encapsulate complex programs with their dependencies in isolated environments making applications more compatible and portable. Often HPC systems have higher security levels compared to Cloud systems, which restrict users' ability to customise environments. Therefore, containers on HPC need to include a heavy package of libraries making their size relatively large. These libraries usually are specifically optimised for the hardware, which compromises portability of containers. Per contra, a Cloud container has smaller volume and is more portable. Furthermore, containers would benefit from orchestrators that facilitate deployment and management of containers at a large scale. Cloud systems in practice usually incorporate sophisticated container orchestration mechanisms as opposed to HPC systems. Nevertheless, some solutions to enable container orchestration on HPC systems have been proposed in state of the art. This paper gives a survey and taxonomy of efforts in both containerisation and its orchestration strategies on HPC systems. It highlights differences thereof between Cloud and HPC. Lastly, challenges are discussed and the potentials for research and engineering are envisioned.
△ Less
Submitted 16 December, 2022;
originally announced December 2022.
-
Improving saliency models' predictions of the next fixation with humans' intrinsic cost of gaze shifts
Authors:
Florian Kadner,
Tobias Thomas,
David Hoppe,
Constantin A. Rothkopf
Abstract:
The human prioritization of image regions can be modeled in a time invariant fashion with saliency maps or sequentially with scanpath models. However, while both types of models have steadily improved on several benchmarks and datasets, there is still a considerable gap in predicting human gaze. Here, we leverage two recent developments to reduce this gap: theoretical analyses establishing a princ…
▽ More
The human prioritization of image regions can be modeled in a time invariant fashion with saliency maps or sequentially with scanpath models. However, while both types of models have steadily improved on several benchmarks and datasets, there is still a considerable gap in predicting human gaze. Here, we leverage two recent developments to reduce this gap: theoretical analyses establishing a principled framework for predicting the next gaze target and the empirical measurement of the human cost for gaze switches independently of image content. We introduce an algorithm in the framework of sequential decision making, which converts any static saliency map into a sequence of dynamic history-dependent value maps, which are recomputed after each gaze shift. These maps are based on 1) a saliency map provided by an arbitrary saliency model, 2) the recently measured human cost function quantifying preferences in magnitude and direction of eye movements, and 3) a sequential exploration bonus, which changes with each subsequent gaze shift. The parameters of the spatial extent and temporal decay of this exploration bonus are estimated from human gaze data. The relative contributions of these three components were optimized on the MIT1003 dataset for the NSS score and are sufficient to significantly outperform predictions of the next gaze target on NSS and AUC scores for five state of the art saliency models on three image data sets. Thus, we provide an implementation of human gaze preferences, which can be used to improve arbitrary saliency models' predictions of humans' next gaze targets.
△ Less
Submitted 18 February, 2024; v1 submitted 9 July, 2022;
originally announced July 2022.
-
Monitoring in the Clouds: Comparison of ECO2Clouds and EXCESS Monitoring Approaches
Authors:
Pavel Skvortsov,
Dennis Hoppe,
Axel Tenschert,
Michael Gienger
Abstract:
With the increasing adoption of private cloud infrastructures by providers and enterprises, the monitoring of these infrastructures is becoming crucial. The rationale behind monitoring is manifold: reasons include saving energy, lowering costs, and better maintenance. In the e-Science sector, moreover, the collection of infrastructure and application-specific data at high resolutions is immanent.…
▽ More
With the increasing adoption of private cloud infrastructures by providers and enterprises, the monitoring of these infrastructures is becoming crucial. The rationale behind monitoring is manifold: reasons include saving energy, lowering costs, and better maintenance. In the e-Science sector, moreover, the collection of infrastructure and application-specific data at high resolutions is immanent. In this paper, we present two monitoring approaches implemented throughout two European projects: ECO2Clouds and EXCESS. The ECO2Clouds project aims to minimize CO2 emissions caused by the execution of applications on the cloud infrastructure. In order to allow for eco-aware deployment and scheduling of applications, the ECO2Clouds monitoring framework provides the necessary set of metrics on different layers including physical, virtual and application layer. In turn, the EXCESS project introduces new energy-aware execution models that improve energy-efficiency on a software level. Having in-depth knowledge about the energy consumption and overall behavior of applications on a given infrastructure, subsequent executions can be optimized to save energy. To achieve this goal, the EXCESS monitoring framework provides APIs allowing developers to collect application-specific data in addition to infrastructure data at run-time. We perform a comparative analysis of both monitoring approaches, and highlighting use cases including a hybrid approach which benefits from both monitoring solutions.
△ Less
Submitted 27 January, 2016;
originally announced January 2016.