-
Particle-Wise Higher-Order SPH Field Approximation for DVR
Authors:
Jonathan Fischer,
Martin Schulze,
Paul Rosenthal,
Lars Linsen
Abstract:
When employing Direct Volume Rendering (DVR) for visualizing volumetric scalar fields, classification is generally performed on a piecewise constant or piecewise linear approximation of the field on a viewing ray. Smoothed Particle Hydrodynamics (SPH) data sets define volumetric scalar fields as the sum of individual particle contributions, at highly varying spatial resolution. We present an appro…
▽ More
When employing Direct Volume Rendering (DVR) for visualizing volumetric scalar fields, classification is generally performed on a piecewise constant or piecewise linear approximation of the field on a viewing ray. Smoothed Particle Hydrodynamics (SPH) data sets define volumetric scalar fields as the sum of individual particle contributions, at highly varying spatial resolution. We present an approach for approximating SPH scalar fields along viewing rays with piece-wise polynomial functions of higher order. This is done by approximating each particle contribution individually and then efficiently summing the results, thus generating a higher-order representation of the field with a resolution adapting to the data resolution in the volume.
△ Less
Submitted 5 January, 2024;
originally announced January 2024.
-
Voreen -- An Open-source Framework for Interactive Visualization and Processing of Large Volume Data
Authors:
Dominik Drees,
Simon Leistikow,
Xiaoyi Jiang,
Lars Linsen
Abstract:
Technological advances for measuring or simulating volume data have led to large data sizes in many research areas such as biology, medicine, physics, and geoscience. Here, large data can refer to individual data sets with high spatial and/or temporal resolution as well as collections of data sets in the sense of cohorts or ensembles. Therefore, general-purpose and customizable volume visualizatio…
▽ More
Technological advances for measuring or simulating volume data have led to large data sizes in many research areas such as biology, medicine, physics, and geoscience. Here, large data can refer to individual data sets with high spatial and/or temporal resolution as well as collections of data sets in the sense of cohorts or ensembles. Therefore, general-purpose and customizable volume visualization and processing systems have to provide out-of-core mechanisms that allow for handling and analyzing such data. Voreen is an open-source rapid-prototy** framework that was originally designed to quickly create custom visualization applications for volumetric imaging data using the meanwhile quite common data flow graph paradigm. In recent years, Voreen has been used in various interdisciplinary research projects with an increasing demand for large data processing capabilities without relying on cluster compute resources. In its latest release, Voreen has thus been extended by out-of-core techniques for processing and visualization of volume data with very high spatial resolution as well as collections of volume data sets including spatio-temporal multi-field simulation ensembles. In this paper we compare state-of-the-art volume processing and visualization systems and conclude that Voreen is the first system combining out-of-core processing and rendering capabilities for large volume data on consumer hardware with features important for interdisciplinary research. We describe how Voreen achieves these goals and show-case its use, performance, and capability to support interdisciplinary research by presenting typical workflows within two large volume data case studies.
△ Less
Submitted 26 July, 2022;
originally announced July 2022.
-
ASEVis: Visual Exploration of Active System Ensembles to Define Characteristic Measures
Authors:
Marina Evers,
Raphael Wittkowski,
Lars Linsen
Abstract:
Simulation ensembles are a common tool in physics for understanding how a model outcome depends on input parameters. We analyze an active particle system, where each particle can use energy from its surroundings to propel itself. A multi-dimensional feature vector containing all particles' motion information can describe the whole system at each time step. The system's behavior strongly depends on…
▽ More
Simulation ensembles are a common tool in physics for understanding how a model outcome depends on input parameters. We analyze an active particle system, where each particle can use energy from its surroundings to propel itself. A multi-dimensional feature vector containing all particles' motion information can describe the whole system at each time step. The system's behavior strongly depends on input parameters like the propulsion mechanism of the particles. To understand how the time-varying behavior depends on the input parameters, it is necessary to introduce new measures to quantify the difference of the dynamics of the ensemble members. We propose a tool that supports the interactive visual analysis of time-varying feature-vector ensembles. A core component of our tool allows for the interactive definition and refinement of new measures that can then be used to understand the system's behavior and compare the ensemble members. Different visualizations support the user in finding a characteristic measure for the system. By visualizing the user-defined measure, the user can then investigate the parameter dependencies and gain insights into the relationship between input parameters and simulation output.
△ Less
Submitted 13 July, 2022;
originally announced July 2022.
-
Multi-dimensional parameter-space partitioning of spatio-temporal simulation ensembles
Authors:
Marina Evers,
Lars Linsen
Abstract:
Numerical simulations are commonly used to understand the parameter dependence of given spatio-temporal phenomena. Sampling a multi-dimensional parameter space and running the respective simulations leads to an ensemble of a large number of spatio-temporal simulation runs. A main objective for analyzing the ensemble is to partition (or segment) the multi-dimensional parameter space into connected…
▽ More
Numerical simulations are commonly used to understand the parameter dependence of given spatio-temporal phenomena. Sampling a multi-dimensional parameter space and running the respective simulations leads to an ensemble of a large number of spatio-temporal simulation runs. A main objective for analyzing the ensemble is to partition (or segment) the multi-dimensional parameter space into connected regions of simulation runs with similar behavior. To facilitate such an analysis, we propose a novel visualization method for multi-dimensional parameter-space partitions. Our visualization is based on the concept of a hyper-slicer, which allows for undistorted views of the parameter-space segments' extent and transitions. For navigation within the parameter space, interactions with a 2D embedding of the parameter-space samples, including their segment memberships, are supported. Parameter-space partitions are generated in a semi-automatic fashion by analyzing the similarity space of the ensemble's simulation runs. Clusters of similar simulation runs induce the segments of the parameter-space partition. We link the parameter-space partitioning visualizations to similarity-space visualizations of the ensemble's simulation runs and embed them into an interactive visual analysis tool that supports the analysis of all facets of the spatio-temporal simulation ensemble targeted at the overarching goal of analyzing the parameter-space partitioning. The partitioning can then be visually analyzed and interactively refined. We evaluated our approach with experts within case studies from three different domains.
△ Less
Submitted 3 May, 2022; v1 submitted 2 May, 2022;
originally announced May 2022.
-
Uncertainty-aware Topic Modeling Visualization
Authors:
Valerie Müller,
Christian Sieg,
Lars Linsen
Abstract:
Topic modeling is a state-of-the-art technique for analyzing text corpora. It uses a statistical model, most commonly Latent Dirichlet Allocation (LDA), to discover abstract topics that occur in the document collection. However, the LDA-based topic modeling procedure is based on a randomly selected initial configuration as well as a number of parameter values than need to be chosen. This induces u…
▽ More
Topic modeling is a state-of-the-art technique for analyzing text corpora. It uses a statistical model, most commonly Latent Dirichlet Allocation (LDA), to discover abstract topics that occur in the document collection. However, the LDA-based topic modeling procedure is based on a randomly selected initial configuration as well as a number of parameter values than need to be chosen. This induces uncertainties on the topic modeling results, and visualization methods should convey these uncertainties during the analysis process. We propose a visual uncertainty-aware topic modeling analysis. We capture the uncertainty by computing topic modeling ensembles and propose measures for estimating topic modeling uncertainty from the ensemble. Then, we propose to enhance state-of-the-art topic modeling visualization methods to convey the uncertainty in the topic modeling process. We visualize the entire ensemble of topic modeling results at different levels for topic and document analysis. We apply our visualization methods to a text corpus to document the impact of uncertainty on the analysis.
△ Less
Submitted 18 October, 2021;
originally announced October 2021.
-
The Impact of Activation Sparsity on Overfitting in Convolutional Neural Networks
Authors:
Karim Huesmann,
Luis Garcia Rodriguez,
Lars Linsen,
Benjamin Risse
Abstract:
Overfitting is one of the fundamental challenges when training convolutional neural networks and is usually identified by a diverging training and test loss. The underlying dynamics of how the flow of activations induce overfitting is however poorly understood. In this study we introduce a perplexity-based sparsity definition to derive and visualise layer-wise activation measures. These novel expl…
▽ More
Overfitting is one of the fundamental challenges when training convolutional neural networks and is usually identified by a diverging training and test loss. The underlying dynamics of how the flow of activations induce overfitting is however poorly understood. In this study we introduce a perplexity-based sparsity definition to derive and visualise layer-wise activation measures. These novel explainable AI strategies reveal a surprising relationship between activation sparsity and overfitting, namely an increase in sparsity in the feature extraction layers shortly before the test loss starts rising. This tendency is preserved across network architectures and reguralisation strategies so that our measures can be used as a reliable indicator for overfitting while decoupling the network's generalisation capabilities from its loss-based definition. Moreover, our differentiable sparsity formulation can be used to explicitly penalise the emergence of sparsity during training so that the impact of reduced sparsity on overfitting can be studied in real-time. Applying this penalty and analysing activation sparsity for well known regularisers and in common network architectures supports the hypothesis that reduced activation sparsity can effectively improve the generalisation and classification performance. In line with other recent work on this topic, our methods reveal novel insights into the contradicting concepts of activation sparsity and network capacity by demonstrating that dense activations can enable discriminative feature learning while efficiently exploiting the capacity of deep models without suffering from overfitting, even when trained excessively.
△ Less
Submitted 13 April, 2021;
originally announced April 2021.
-
Exploiting the Full Capacity of Deep Neural Networks while Avoiding Overfitting by Targeted Sparsity Regularization
Authors:
Karim Huesmann,
Soeren Klemm,
Lars Linsen,
Benjamin Risse
Abstract:
Overfitting is one of the most common problems when training deep neural networks on comparatively small datasets. Here, we demonstrate that neural network activation sparsity is a reliable indicator for overfitting which we utilize to propose novel targeted sparsity visualization and regularization strategies. Based on these strategies we are able to understand and counteract overfitting caused b…
▽ More
Overfitting is one of the most common problems when training deep neural networks on comparatively small datasets. Here, we demonstrate that neural network activation sparsity is a reliable indicator for overfitting which we utilize to propose novel targeted sparsity visualization and regularization strategies. Based on these strategies we are able to understand and counteract overfitting caused by activation sparsity and filter correlation in a targeted layer-by-layer manner. Our results demonstrate that targeted sparsity regularization can efficiently be used to regularize well-known datasets and architectures with a significant increase in image classification performance while outperforming both dropout and batch normalization. Ultimately, our study reveals novel insights into the contradicting concepts of activation sparsity and network capacity by demonstrating that targeted sparsity regularization enables salient and discriminative feature learning while exploiting the full capacity of deep models without suffering from overfitting, even when trained excessively.
△ Less
Submitted 21 February, 2020;
originally announced February 2020.
