-
Language-Driven Engineering An Interdisciplinary Software Development Paradigm
Authors:
Bernhard Steffen,
Tiziana Margaria,
Alexander Bainczyk,
Steve Boßelmann,
Daniel Busch,
Marc Driessen,
Markus Frohme,
Falk Howar,
Sven Jörges,
Marvin Krause,
Marco Krumrey,
Anna-Lena Lamprecht,
Michael Lybecait,
Alnis Murtovi,
Stefan Naujokat,
Johannes Neubauer,
Alexander Schieweck,
Jonas Schürmann,
Steven Smyth,
Barbara Steffen,
Fabian Storek,
Tim Tegeler,
Sebastian Teumert,
Dominic Wirkner,
Philip Zweihoff
Abstract:
We illustrate how purpose-specific, graphical modeling enables application experts with different levels of expertise to collaboratively design and then produce complex applications using their individual, purpose-specific modeling language. Our illustration includes seven graphical Integrated Modeling Environments (IMEs) that support full code generation, as well as four browser-based application…
▽ More
We illustrate how purpose-specific, graphical modeling enables application experts with different levels of expertise to collaboratively design and then produce complex applications using their individual, purpose-specific modeling language. Our illustration includes seven graphical Integrated Modeling Environments (IMEs) that support full code generation, as well as four browser-based applications that were modeled and then fully automatically generated and produced using DIME, our most complex graphical IME. While the seven IMEs were chosen to illustrate the types of languages we support with our Language-Driven Engineering (LDE) approach, the four DIME products were chosen to give an impression of the power of our LDE-generated IMEs. In fact, Equinocs, Springer Nature's future editorial system for proceedings, is also being fully automatically generated and then deployed at their Dordrecht site using a deployment pipeline generated with Rig, one of the IMEs presented. Our technology is open source and the products presented are currently in use.
△ Less
Submitted 16 February, 2024;
originally announced February 2024.
-
LONEStar: The Lunar Flashlight Optical Navigation Experiment
Authors:
Michael Krause,
Ava Thrasher,
Priyal Soni,
Liam Smego,
Reuben Isaac,
Jennifer Nolan,
Micah Pledger,
E. Glenn Lightsey,
W. Jud Ready,
John Christian
Abstract:
This paper documents the results from the highly successful Lunar flashlight Optical Navigation Experiment with a Star tracker (LONEStar). Launched in December 2022, Lunar Flashlight (LF) was a NASA-funded technology demonstration mission. After a propulsion system anomaly prevented capture in lunar orbit, LF was ejected from the Earth-Moon system and into heliocentric space. NASA subsequently tra…
▽ More
This paper documents the results from the highly successful Lunar flashlight Optical Navigation Experiment with a Star tracker (LONEStar). Launched in December 2022, Lunar Flashlight (LF) was a NASA-funded technology demonstration mission. After a propulsion system anomaly prevented capture in lunar orbit, LF was ejected from the Earth-Moon system and into heliocentric space. NASA subsequently transferred ownership of LF to Georgia Tech to conduct an unfunded extended mission to demonstrate further advanced technology objectives, including LONEStar. From August-December 2023, the LONEStar team performed on-orbit calibration of the optical instrument and a number of different OPNAV experiments. This campaign included the processing of nearly 400 images of star fields, Earth and Moon, and four other planets (Mercury, Mars, Jupiter, and Saturn). LONEStar provided the first on-orbit demonstrations of heliocentric navigation using only optical observations of planets. Of special note is the successful in-flight demonstration of (1) instantaneous triangulation with simultaneous sightings of two planets with the LOST algorithm and (2) dynamic triangulation with sequential sightings of multiple planets.
△ Less
Submitted 22 January, 2024;
originally announced January 2024.
-
Retail Analytics in the New Normal: The Influence of Artificial Intelligence and the Covid-19 Pandemic
Authors:
Yossiri Adulyasak,
Maxime C. Cohen,
Warut Khern-am-nuai,
Michael Krause
Abstract:
The COVID-19 pandemic has severely disrupted the retail landscape and has accelerated the adoption of innovative technologies. A striking example relates to the proliferation of online grocery orders and the technology deployed to facilitate such logistics. In fact, for many retailers, this disruption was a wake-up call after which they started recognizing the power of data analytics and artificia…
▽ More
The COVID-19 pandemic has severely disrupted the retail landscape and has accelerated the adoption of innovative technologies. A striking example relates to the proliferation of online grocery orders and the technology deployed to facilitate such logistics. In fact, for many retailers, this disruption was a wake-up call after which they started recognizing the power of data analytics and artificial intelligence (AI). In this article, we discuss the opportunities that AI can offer to retailers in the new normal retail landscape. Some of the techniques described have been applied at scale to adapt previously deployed AI models, whereas in other instances, fresh solutions needed to be developed to help retailers cope with recent disruptions, such as unexpected panic buying, retraining predictive models, and leveraging online-offline synergies.
△ Less
Submitted 27 November, 2023;
originally announced December 2023.
-
Anisotropic Diffusion Stencils: From Simple Derivations over Stability Estimates to ResNet Implementations
Authors:
Karl Schrader,
Joachim Weickert,
Michael Krause
Abstract:
Anisotropic diffusion processes with a diffusion tensor are important in image analysis, physics, and engineering. However, their numerical approximation has a strong impact on dissipative artefacts and deviations from rotation invariance. In this work, we study a large family of finite difference discretisations on a 3 x 3 stencil. We derive it by splitting 2-D anisotropic diffusion into four 1-D…
▽ More
Anisotropic diffusion processes with a diffusion tensor are important in image analysis, physics, and engineering. However, their numerical approximation has a strong impact on dissipative artefacts and deviations from rotation invariance. In this work, we study a large family of finite difference discretisations on a 3 x 3 stencil. We derive it by splitting 2-D anisotropic diffusion into four 1-D diffusions. The resulting stencil class involves one free parameter and covers a wide range of existing discretisations. It comprises the full stencil family of Weickert et al. (2013) and shows that their two parameters contain redundancy. Furthermore, we establish a bound on the spectral norm of the matrix corresponding to the stencil. This gives time step size limits that guarantee stability of an explicit scheme in the Euclidean norm. Our directional splitting also allows a very natural translation of the explicit scheme into ResNet blocks. Employing neural network libraries enables simple and highly efficient parallel implementations on GPUs.
△ Less
Submitted 8 April, 2024; v1 submitted 11 September, 2023;
originally announced September 2023.
-
Stabilizing Training with Soft Dynamic Time War**: A Case Study for Pitch Class Estimation with Weakly Aligned Targets
Authors:
Johannes Zeitler,
Simon Deniffel,
Michael Krause,
Meinard Müller
Abstract:
Soft dynamic time war** (SDTW) is a differentiable loss function that allows for training neural networks from weakly aligned data. Typically, SDTW is used to iteratively compute and refine soft alignments that compensate for temporal deviations between the training data and its weakly annotated targets. One major problem is that a mismatch between the estimated soft alignments and the reference…
▽ More
Soft dynamic time war** (SDTW) is a differentiable loss function that allows for training neural networks from weakly aligned data. Typically, SDTW is used to iteratively compute and refine soft alignments that compensate for temporal deviations between the training data and its weakly annotated targets. One major problem is that a mismatch between the estimated soft alignments and the reference alignments in the early training stage leads to incorrect parameter updates, making the overall training procedure unstable. In this paper, we investigate such stability issues by considering the task of pitch class estimation from music recordings as an illustrative case study. In particular, we introduce and discuss three conceptually different strategies (a hyperparameter scheduling, a diagonal prior, and a sequence unfolding strategy) with the objective of stabilizing intermediate soft alignment results. Finally, we report on experiments that demonstrate the effectiveness of the strategies and discuss efficiency and implementation issues.
△ Less
Submitted 10 August, 2023;
originally announced August 2023.
-
OpenLB User Guide: Associated with Release 1.6 of the Code
Authors:
Adrian Kummerländer,
Samuel J. Avis,
Halim Kusumaatmaja,
Fedor Bukreev,
Michael Crocoll,
Davide Dapelo,
Simon Großmann,
Nicolas Hafen,
Shota Ito,
Julius Jeßberger,
Eliane Kummer,
Jan E. Marquardt,
Johanna Mödl,
Tim Pertzel,
František Prinz,
Florian Raichle,
Martin Sadric,
Maximilian Schecher,
Dennis Teutscher,
Stephan Simonis,
Mathias J. Krause
Abstract:
OpenLB is an object-oriented implementation of LBM. It is the first implementation of a generic platform for LBM programming, which is shared with the open source community (GPLv2). Since the first release in 2007, the code has been continuously improved and extended which is documented by thirteen releases as well as the corresponding release notes which are available on the OpenLB website (https…
▽ More
OpenLB is an object-oriented implementation of LBM. It is the first implementation of a generic platform for LBM programming, which is shared with the open source community (GPLv2). Since the first release in 2007, the code has been continuously improved and extended which is documented by thirteen releases as well as the corresponding release notes which are available on the OpenLB website (https://www.openlb.net). The OpenLB code is written in C++ and is used by application programmers as well as developers, with the ability to implement custom models OpenLB supports complex data structures that allow simulations in complex geometries and parallel execution using MPI, OpenMP and CUDA on high-performance computers. The source code uses the concepts of interfaces and templates, so that efficient, direct and intuitive implementations of the LBM become possible. The efficiency and scalability has been checked and proved by code reviews. This user manual and a source code documentation by DoxyGen are available on the OpenLB project website.
△ Less
Submitted 17 May, 2023;
originally announced July 2023.
-
Unsupervised Change Point Detection for heterogeneous sensor signals
Authors:
Mario Krause
Abstract:
Change point detection is a crucial aspect of analyzing time series data, as the presence of a change point indicates an abrupt and significant change in the process generating the data. While many algorithms for the problem of change point detection have been developed over time, it can be challenging to select the appropriate algorithm for a specific problem. The choice of the algorithm heavily…
▽ More
Change point detection is a crucial aspect of analyzing time series data, as the presence of a change point indicates an abrupt and significant change in the process generating the data. While many algorithms for the problem of change point detection have been developed over time, it can be challenging to select the appropriate algorithm for a specific problem. The choice of the algorithm heavily depends on the nature of the problem and the underlying data source. In this paper, we will exclusively examine unsupervised techniques due to their flexibility in the application to various data sources without the requirement for abundant annotated training data and the re-calibration of the model. The examined methods will be introduced and evaluated based on several criteria to compare the algorithms.
△ Less
Submitted 19 May, 2023;
originally announced May 2023.
-
Soft Dynamic Time War** for Multi-Pitch Estimation and Beyond
Authors:
Michael Krause,
Christof Weiß,
Meinard Müller
Abstract:
Many tasks in music information retrieval (MIR) involve weakly aligned data, where exact temporal correspondences are unknown. The connectionist temporal classification (CTC) loss is a standard technique to learn feature representations based on weakly aligned training data. However, CTC is limited to discrete-valued target sequences and can be difficult to extend to multi-label problems. In this…
▽ More
Many tasks in music information retrieval (MIR) involve weakly aligned data, where exact temporal correspondences are unknown. The connectionist temporal classification (CTC) loss is a standard technique to learn feature representations based on weakly aligned training data. However, CTC is limited to discrete-valued target sequences and can be difficult to extend to multi-label problems. In this article, we show how soft dynamic time war** (SoftDTW), a differentiable variant of classical DTW, can be used as an alternative to CTC. Using multi-pitch estimation as an example scenario, we show that SoftDTW yields results on par with a state-of-the-art multi-label extension of CTC. In addition to being more elegant in terms of its algorithmic formulation, SoftDTW naturally extends to real-valued target sequences.
△ Less
Submitted 11 April, 2023;
originally announced April 2023.
-
Semantic Segmentation for Fully Automated Macrofouling Analysis on Coatings after Field Exposure
Authors:
Lutz M. K. Krause,
Emily Manderfeld,
Patricia Gnutt,
Louisa Vogler,
Ann Wassick,
Kailey Richard,
Marco Rudolph,
Kelli Z. Hunsucker,
Geoffrey W. Swain,
Bodo Rosenhahn,
Axel Rosenhahn
Abstract:
Biofouling is a major challenge for sustainable ship**, filter membranes, heat exchangers, and medical devices. The development of fouling-resistant coatings requires the evaluation of their effectiveness. Such an evaluation is usually based on the assessment of fouling progression after different exposure times to the target medium (e.g., salt water). The manual assessment of macrofouling requi…
▽ More
Biofouling is a major challenge for sustainable ship**, filter membranes, heat exchangers, and medical devices. The development of fouling-resistant coatings requires the evaluation of their effectiveness. Such an evaluation is usually based on the assessment of fouling progression after different exposure times to the target medium (e.g., salt water). The manual assessment of macrofouling requires expert knowledge about local fouling communities due to high variances in phenotypical appearance, has single-image sampling inaccuracies for certain species, and lacks spatial information. Here we present an approach for automatic image-based macrofouling analysis. We created a dataset with dense labels prepared from field panel images and propose a convolutional network (adapted U-Net) for the semantic segmentation of different macrofouling classes. The establishment of macrofouling localization allows for the generation of a successional model which enables the determination of direct surface attachment and in-depth epibiotic studies.
△ Less
Submitted 21 November, 2022;
originally announced November 2022.
-
Topological Classification in a Wasserstein Distance Based Vector Space
Authors:
Tananun Songdechakraiwut,
Bryan M. Krause,
Matthew I. Banks,
Kirill V. Nourski,
Barry D. Van Veen
Abstract:
Classification of large and dense networks based on topology is very difficult due to the computational challenges of extracting meaningful topological features from real-world networks. In this paper we present a computationally tractable approach to topological classification of networks by using principled theory from persistent homology and optimal transport to define a novel vector representa…
▽ More
Classification of large and dense networks based on topology is very difficult due to the computational challenges of extracting meaningful topological features from real-world networks. In this paper we present a computationally tractable approach to topological classification of networks by using principled theory from persistent homology and optimal transport to define a novel vector representation for topological features. The proposed vector space is based on the Wasserstein distance between persistence barcodes. The 1-skeleton of the network graph is employed to obtain 1-dimensional persistence barcodes that represent connected components and cycles. These barcodes and the corresponding Wasserstein distance can be computed very efficiently. The effectiveness of the proposed vector space is demonstrated using support vector machines to classify simulated networks and measured functional brain networks.
△ Less
Submitted 2 February, 2022;
originally announced February 2022.
-
On the accuracy and performance of the lattice Boltzmann method with 64-bit, 32-bit and novel 16-bit number formats
Authors:
Moritz Lehmann,
Mathias J. Krause,
Giorgio Amati,
Marcello Sega,
Jens Harting,
Stephan Gekle
Abstract:
Fluid dynamics simulations with the lattice Boltzmann method (LBM) are very memory-intensive. Alongside reduction in memory footprint, significant performance benefits can be achieved by using FP32 (single) precision compared to FP64 (double) precision, especially on GPUs. Here, we evaluate the possibility to use even FP16 and Posit16 (half) precision for storing fluid populations, while still car…
▽ More
Fluid dynamics simulations with the lattice Boltzmann method (LBM) are very memory-intensive. Alongside reduction in memory footprint, significant performance benefits can be achieved by using FP32 (single) precision compared to FP64 (double) precision, especially on GPUs. Here, we evaluate the possibility to use even FP16 and Posit16 (half) precision for storing fluid populations, while still carrying arithmetic operations in FP32. For this, we first show that the commonly occurring number range in the LBM is a lot smaller than the FP16 number range. Based on this observation, we develop novel 16-bit formats - based on a modified IEEE-754 and on a modified Posit standard - that are specifically tailored to the needs of the LBM. We then carry out an in-depth characterization of LBM accuracy for six different test systems with increasing complexity: Poiseuille flow, Taylor-Green vortices, Karman vortex streets, lid-driven cavity, a microcapsule in shear flow (utilizing the immersed-boundary method) and finally the impact of a raindrop (based on a Volume-of-Fluid approach). We find that the difference in accuracy between FP64 and FP32 is negligible in almost all cases, and that for a large number of cases even 16-bit is sufficient. Finally, we provide a detailed performance analysis of all precision levels on a large number of hardware microarchitectures and show that significant speedup is achieved with mixed FP32/16-bit.
△ Less
Submitted 31 January, 2022; v1 submitted 16 December, 2021;
originally announced December 2021.
-
Fast Topological Clustering with Wasserstein Distance
Authors:
Tananun Songdechakraiwut,
Bryan M. Krause,
Matthew I. Banks,
Kirill V. Nourski,
Barry D. Van Veen
Abstract:
The topological patterns exhibited by many real-world networks motivate the development of topology-based methods for assessing the similarity of networks. However, extracting topological structure is difficult, especially for large and dense networks whose node degrees range over multiple orders of magnitude. In this paper, we propose a novel and computationally practical topological clustering m…
▽ More
The topological patterns exhibited by many real-world networks motivate the development of topology-based methods for assessing the similarity of networks. However, extracting topological structure is difficult, especially for large and dense networks whose node degrees range over multiple orders of magnitude. In this paper, we propose a novel and computationally practical topological clustering method that clusters complex networks with intricate topology using principled theory from persistent homology and optimal transport. Such networks are aggregated into clusters through a centroid-based clustering strategy based on both their topological and geometric structure, preserving correspondence between nodes in different networks. The notions of topological proximity and centroid are characterized using a novel and efficient approach to computation of the Wasserstein distance and barycenter for persistence barcodes associated with connected components and cycles. The proposed method is demonstrated to be effective using both simulated networks and measured functional brain networks.
△ Less
Submitted 13 March, 2022; v1 submitted 30 November, 2021;
originally announced December 2021.
-
Mobile Game User Research: The World as Your Lab?
Authors:
Jan Smeddinck,
Markus Krause,
Kolja Lubitz
Abstract:
With the advent of mobile games and the according growing and competitive market, game user research can provide valuable insights and a competitive edge if methods and procedures are employed that match the distinct challenges that mobile devices, games and usage scenarios induce. We present a summary of parameters that frame the research setup and procedure, focusing on the trade-offs between la…
▽ More
With the advent of mobile games and the according growing and competitive market, game user research can provide valuable insights and a competitive edge if methods and procedures are employed that match the distinct challenges that mobile devices, games and usage scenarios induce. We present a summary of parameters that frame the research setup and procedure, focusing on the trade-offs between lab and field studies and the related decision whether to pursue large-scale and quantitative or small-scale focused research accompanied by qualitative methods. We then illustrate the implications of these considerations on real world projects along the lines of two evaluations of different input methods for the action-puzzle mobile game Somyeol: a local study with 37 participants and a mixed design of qualitative and quantitative methods, and the strictly quantitative analysis of game-play data from 117,118 users. The findings underline the importance of small-scale evaluations prior to release.
△ Less
Submitted 1 December, 2020;
originally announced December 2020.
-
MOTS: Multi-Object Tracking and Segmentation
Authors:
Paul Voigtlaender,
Michael Krause,
Aljosa Osep,
Jonathon Luiten,
Berin Balachandar Gnana Sekar,
Andreas Geiger,
Bastian Leibe
Abstract:
This paper extends the popular task of multi-object tracking to multi-object tracking and segmentation (MOTS). Towards this goal, we create dense pixel-level annotations for two existing tracking datasets using a semi-automatic annotation procedure. Our new annotations comprise 65,213 pixel masks for 977 distinct objects (cars and pedestrians) in 10,870 video frames. For evaluation, we extend exis…
▽ More
This paper extends the popular task of multi-object tracking to multi-object tracking and segmentation (MOTS). Towards this goal, we create dense pixel-level annotations for two existing tracking datasets using a semi-automatic annotation procedure. Our new annotations comprise 65,213 pixel masks for 977 distinct objects (cars and pedestrians) in 10,870 video frames. For evaluation, we extend existing multi-object tracking metrics to this new task. Moreover, we propose a new baseline method which jointly addresses detection, tracking, and segmentation with a single convolutional network. We demonstrate the value of our datasets by achieving improvements in performance when training on MOTS annotations. We believe that our datasets, metrics and baseline will become a valuable resource towards develo** multi-object tracking approaches that go beyond 2D bounding boxes. We make our annotations, code, and models available at https://www.vision.rwth-aachen.de/page/mots.
△ Less
Submitted 8 April, 2019; v1 submitted 10 February, 2019;
originally announced February 2019.
-
Optimal redundancy against disjoint vulnerabilities in networks
Authors:
Sebastian M. Krause,
Michael M. Danziger,
Vinko Zlatić
Abstract:
Redundancy is commonly used to guarantee continued functionality in networked systems. However, often many nodes are vulnerable to the same failure or adversary. A "backup" path is not sufficient if both paths depend on nodes which share a vulnerability.For example, if two nodes of the Internet cannot be connected without using routers belonging to a given untrusted entity, then all of their commu…
▽ More
Redundancy is commonly used to guarantee continued functionality in networked systems. However, often many nodes are vulnerable to the same failure or adversary. A "backup" path is not sufficient if both paths depend on nodes which share a vulnerability.For example, if two nodes of the Internet cannot be connected without using routers belonging to a given untrusted entity, then all of their communication-regardless of the specific paths utilized-will be intercepted by the controlling entity.In this and many other cases, the vulnerabilities affecting the network are disjoint: each node has exactly one vulnerability but the same vulnerability can affect many nodes. To discover optimal redundancy in this scenario, we describe each vulnerability as a color and develop a "color-avoiding percolation" which uncovers a hidden color-avoiding connectivity. We present algorithms for color-avoiding percolation of general networks and an analytic theory for random graphs with uniformly distributed colors including critical phenomena. We demonstrate our theory by uncovering the hidden color-avoiding connectivity of the Internet. We find that less well-connected countries are more likely able to communicate securely through optimally redundant paths than highly connected countries like the US. Our results reveal a new layer of hidden structure in complex systems and can enhance security and robustness through optimal redundancy in a wide range of systems including biological, economic and communications networks.
△ Less
Submitted 13 March, 2015;
originally announced March 2015.
-
Spontaneous centralization of control in a network of company ownerships
Authors:
Sebastian M. Krause,
Tiago P. Peixoto,
Stefan Bornholdt
Abstract:
We introduce a model for the adaptive evolution of a network of company ownerships. In a recent work it has been shown that the empirical global network of corporate control is marked by a central, tightly connected "core" made of a small number of large companies which control a significant part of the global economy. Here we show how a simple, adaptive "rich get richer" dynamics can account for…
▽ More
We introduce a model for the adaptive evolution of a network of company ownerships. In a recent work it has been shown that the empirical global network of corporate control is marked by a central, tightly connected "core" made of a small number of large companies which control a significant part of the global economy. Here we show how a simple, adaptive "rich get richer" dynamics can account for this characteristic, which incorporates the increased buying power of more influential companies, and in turn results in even higher control. We conclude that this kind of centralized structure can emerge without it being an explicit goal of these companies, or as a result of a well-organized strategy.
△ Less
Submitted 14 June, 2013;
originally announced June 2013.
-
Opinion formation model for markets with a social temperature and fear
Authors:
Sebastian M. Krause,
Stefan Bornholdt
Abstract:
In the spirit of behavioral finance, we study the process of opinion formation among investors using a variant of the 2D Voter Model with a tunable social temperature. Further, a feedback acting on the temperature is introduced, such that social temperature reacts to market imbalances and thus becomes time dependent. In this toy market model, social temperature represents nervousness of agents tow…
▽ More
In the spirit of behavioral finance, we study the process of opinion formation among investors using a variant of the 2D Voter Model with a tunable social temperature. Further, a feedback acting on the temperature is introduced, such that social temperature reacts to market imbalances and thus becomes time dependent. In this toy market model, social temperature represents nervousness of agents towards market imbalances representing speculative risk. We use the knowledge about the discontinuous Generalized Voter Model phase transition to determine critical fixed points. The system exhibits metastable phases around these fixed points characterized by structured lattice states, with intermittent excursions away from the fixed points. The statistical mechanics of the model is characterized and its relation to dynamics of opinion formation among investors in real markets is discussed.
△ Less
Submitted 19 December, 2012;
originally announced December 2012.