-
Comparative evaluation of earthquake forecasting models: An application to Italy
Authors:
Jonas R. Brehmer,
Kristof Kraus,
Tilmann Gneiting,
Marcus Herrmann,
Warner Marzocchi
Abstract:
Testing earthquake forecasts is essential to obtain scientific information on forecasting models and sufficient credibility for societal usage. We aim at enhancing the testing phase proposed by the Collaboratory for the Study of Earthquake Predictability (CSEP, Schorlemmer et al., 2018) with new statistical methods supported by mathematical theory. To demonstrate their applicability, we evaluate t…
▽ More
Testing earthquake forecasts is essential to obtain scientific information on forecasting models and sufficient credibility for societal usage. We aim at enhancing the testing phase proposed by the Collaboratory for the Study of Earthquake Predictability (CSEP, Schorlemmer et al., 2018) with new statistical methods supported by mathematical theory. To demonstrate their applicability, we evaluate three short-term forecasting models that were submitted to the CSEP Italy experiment, and two ensemble models thereof. The models produce weekly overlap** forecasts for the expected number of M4+ earthquakes in a collection of grid cells. We compare the models' forecasts using consistent scoring functions for means or expectations, which are widely used and theoretically principled tools for forecast evaluation. We further discuss and demonstrate their connection to CSEP-style earthquake likelihood model testing. Then, using tools from isotonic regression, we investigate forecast reliability and apply score decompositions in terms of calibration and discrimination. Our results show where and how models outperform their competitors and reveal a substantial lack of calibration for various models. The proposed methods also apply to full-distribution (e.g., catalog-based) forecasts, without requiring Poisson distributions or making any other type of parametric assumption.
△ Less
Submitted 17 May, 2024;
originally announced May 2024.
-
The HaLLMark Effect: Supporting Provenance and Transparent Use of Large Language Models in Writing with Interactive Visualization
Authors:
Md Naimul Hoque,
Tasfia Mashiat,
Bhavya Ghai,
Cecilia Shelton,
Fanny Chevalier,
Kari Kraus,
Niklas Elmqvist
Abstract:
The use of Large Language Models (LLMs) for writing has sparked controversy both among readers and writers. On one hand, writers are concerned that LLMs will deprive them of agency and ownership, and readers are concerned about spending their time on text generated by soulless machines. On the other hand, AI-assistance can improve writing as long as writers can conform to publisher policies, and a…
▽ More
The use of Large Language Models (LLMs) for writing has sparked controversy both among readers and writers. On one hand, writers are concerned that LLMs will deprive them of agency and ownership, and readers are concerned about spending their time on text generated by soulless machines. On the other hand, AI-assistance can improve writing as long as writers can conform to publisher policies, and as long as readers can be assured that a text has been verified by a human. We argue that a system that captures the provenance of interaction with an LLM can help writers retain their agency, conform to policies, and communicate their use of AI to publishers and readers transparently. Thus we propose HaLLMark, a tool for visualizing the writer's interaction with the LLM. We evaluated HaLLMark with 13 creative writers, and found that it helped them retain a sense of control and ownership of the text.
△ Less
Submitted 23 March, 2024; v1 submitted 21 November, 2023;
originally announced November 2023.
-
Portrayal: Leveraging NLP and Visualization for Analyzing Fictional Characters
Authors:
Md Naimul Hoque,
Bhavya Ghai,
Kari Kraus,
Niklas Elmqvist
Abstract:
Many creative writing tasks (e.g., fiction writing) require authors to write complex narrative components (e.g., characterization, events, dialogue) over the course of a long story. Similarly, literary scholars need to manually annotate and interpret texts to understand such abstract components. In this paper, we explore how Natural Language Processing (NLP) and interactive visualization can help…
▽ More
Many creative writing tasks (e.g., fiction writing) require authors to write complex narrative components (e.g., characterization, events, dialogue) over the course of a long story. Similarly, literary scholars need to manually annotate and interpret texts to understand such abstract components. In this paper, we explore how Natural Language Processing (NLP) and interactive visualization can help writers and scholars in such scenarios. To this end, we present Portrayal, an interactive visualization system for analyzing characters in a story. Portrayal extracts natural language indicators from a text to capture the characterization process and then visualizes the indicators in an interactive interface. We evaluated the system with 12 creative writers and scholars in a one-week-long qualitative study. Our findings suggest Portrayal helped writers revise their drafts and create dynamic characters and scenes. It helped scholars analyze characters without the need for any manual annotation, and design literary arguments with concrete evidence.
△ Less
Submitted 8 August, 2023;
originally announced August 2023.
-
On the online path extension problem -- Location and routing problems in board games
Authors:
Konstantin Kraus,
Kathrin Klamroth,
Michael Stiglmayr
Abstract:
We consider an online version of a longest path problem in an undirected and planar graph that is motivated by a location and routing problem occurring in the board game "Turn & Taxis". Path extensions have to be selected based on only partial knowledge on the order in which nodes become available in later iterations. Besides board games, online path extension problems have applications in disaste…
▽ More
We consider an online version of a longest path problem in an undirected and planar graph that is motivated by a location and routing problem occurring in the board game "Turn & Taxis". Path extensions have to be selected based on only partial knowledge on the order in which nodes become available in later iterations. Besides board games, online path extension problems have applications in disaster relief management when infrastructure has to be rebuilt after natural disasters. For example, flooding may affect large parts of a road network, and parts of the network may become available only iteratively and decisions may have to be made without the possibility of planning ahead.
We suggest and analyse selection criteria that identify promising nodes (locations) for path extensions. We introduce the concept of tentacles of paths as an indicator for the future extendability. Different initialization and extension heuristics are suggested on compared to an ideal solution that is obtained by an integer linear programming formulation assuming complete knowledge, i.e., assuming that the complete sequence in which nodes become available is known beforehand. All algorithms are tested and evaluated on the original "Turn & Taxis" graph, and on an extended version of the "Turn & Taxis" graph, with different parameter settings. The numerical results confirm that the number of tentacles is a useful criterion when selecting path extensions, leading to near-optimal paths at relatively low computational costs.
△ Less
Submitted 22 May, 2023;
originally announced May 2023.
-
Optimum Design of Printable Tunable Stiffness Metamaterial for Bone Healing
Authors:
Mohammad Saber Hashemi,
Karl H. Kraus,
Azadeh Sheidae
Abstract:
A tunable stiffness bone rod was designed, optimized, and 3D printed to address the common shortcomings of existing bone rods in the healing of long fractured bones. The common deficiencies of existing bone fixations are high stiffness, thereby negligible flexibility in deformation for best bone growth results, and stress-shielding effect. Our novel design framework provides the surgeons with read…
▽ More
A tunable stiffness bone rod was designed, optimized, and 3D printed to address the common shortcomings of existing bone rods in the healing of long fractured bones. The common deficiencies of existing bone fixations are high stiffness, thereby negligible flexibility in deformation for best bone growth results, and stress-shielding effect. Our novel design framework provides the surgeons with ready-for-3D-printing patient-specific designs, optimized to have desired force-displacement response with a stop** mechanism for preventing further deformation under higher than usual loads such as falling. The framework is a design optimization based on the multi-objective genetic algorithm (GA) optimization to quantify the objectives, tunning the varied stiffness while minimizing the maximum Mises stress of the model to avoid plastic and permanent deformation of the bone rod. The optimum design computational framework of tunable stiffness material presented in this paper is not specific for a tibia bone rod. It can be used for any application where bilinear stiffness is desirable.
△ Less
Submitted 24 June, 2020;
originally announced June 2020.
-
Introducing Multiobjective Complex Systems
Authors:
Tobias Dietz,
Kathrin Klamroth,
Konstantin Kraus,
Stefan Ruzika,
Luca E. Schäfer,
Britta Schulze,
Michael Stiglmayr,
Margaret M. Wiecek
Abstract:
This article focuses on the optimization of a complex system which is composed of several subsystems. On the one hand, these subsystems are subject to multiple objectives, local constraints as well as local variables, and they are associated with an own, subsystem-dependent decision maker. On the other hand, these subsystems are interconnected to each other by global variables or linking constrain…
▽ More
This article focuses on the optimization of a complex system which is composed of several subsystems. On the one hand, these subsystems are subject to multiple objectives, local constraints as well as local variables, and they are associated with an own, subsystem-dependent decision maker. On the other hand, these subsystems are interconnected to each other by global variables or linking constraints. Due to these interdependencies, it is in general not possible to simply optimize each subsystem individually to improve the performance of the overall system. This article introduces a formal graph-based representation of such complex systems and generalizes the classical notions of feasibility and optimality to match this complex situation. Moreover, several algorithmic approaches are suggested and analyzed.
△ Less
Submitted 15 November, 2018;
originally announced November 2018.
-
Algebraic Multilevel Preconditioning in Isogeometric Analysis: Construction and Numerical Studies
Authors:
K. P. S. Gahalaut,
S. K. Tomar,
J. K. Kraus
Abstract:
We present algebraic multilevel iteration (AMLI) methods for isogeometric discretization of scalar second order elliptic problems. The construction of coarse grid operators and hierarchical complementary operators are given. Moreover, for a uniform mesh on a unit interval, the explicit representation of B-spline basis functions for a fixed mesh size $h$ is given for $p=2,3,4$ and for $C^{0}$- and…
▽ More
We present algebraic multilevel iteration (AMLI) methods for isogeometric discretization of scalar second order elliptic problems. The construction of coarse grid operators and hierarchical complementary operators are given. Moreover, for a uniform mesh on a unit interval, the explicit representation of B-spline basis functions for a fixed mesh size $h$ is given for $p=2,3,4$ and for $C^{0}$- and $C^{p-1}$-continuity. The presented methods show $h$- and (almost) $p$-independent convergence rates. Supporting numerical results for convergence factor and iterations count for AMLI cycles ($V$-, linear $W$-, nonlinear $W$-) are provided. Numerical tests are performed, in two-dimensions on square domain and quarter annulus, and in three-dimensions on quarter thick ring.
△ Less
Submitted 6 October, 2013; v1 submitted 1 April, 2013;
originally announced April 2013.
-
Polynomial of best uniform approximation to $x^{-1}$ and smoothing in two-level methods
Authors:
Johannes K. Kraus,
Panayot S. Vassilevski,
Ludmil T. Zikatanov
Abstract:
We derive a three-term recurrence relation for computing the polynomial of best approximation in the uniform norm to $x^{-1}$ on a finite interval with positive endpoints. As application, we consider two-level methods for scalar elliptic partial differential equation (PDE), where the relaxation on the fine grid uses the aforementioned polynomial of best approximation. Based on a new smoothing prop…
▽ More
We derive a three-term recurrence relation for computing the polynomial of best approximation in the uniform norm to $x^{-1}$ on a finite interval with positive endpoints. As application, we consider two-level methods for scalar elliptic partial differential equation (PDE), where the relaxation on the fine grid uses the aforementioned polynomial of best approximation. Based on a new smoothing property of this polynomial smoother that we prove, combined with a proper choice of the coarse space, we obtain as a corollary, that the convergence rate of the resulting two-level method is uniform with respect to the mesh parameters, coarsening ratio and PDE coefficient variation.
△ Less
Submitted 23 May, 2012; v1 submitted 9 February, 2010;
originally announced February 2010.