Showing 1–5 of 5 results for author: Siegle, M

Markov Chain Aggregation with Error Bounds on Transient Distributions

Authors: Fabian Michel, Markus Siegle

Abstract: We extend the existing theory of formal error bounds for the transient distribution of an aggregated (or lumped) Markov chain when compared to the transient distribution of the original chain, for both discrete- and continuous-time Markov chains. In the discrete-time setting, we bound the stepwise increment of the error, and in the continuous-time setting, we bound the rate at which the error grow… ▽ More We extend the existing theory of formal error bounds for the transient distribution of an aggregated (or lumped) Markov chain when compared to the transient distribution of the original chain, for both discrete- and continuous-time Markov chains. In the discrete-time setting, we bound the stepwise increment of the error, and in the continuous-time setting, we bound the rate at which the error grows. We then compare these error bounds with relevant concepts in the literature such as exact and ordinary lumpability as well as deflatability and aggregatability. These concepts define stricter than necessary conditions to identify settings in which the aggregation error is zero. We also consider possible algorithms for finding suitable aggregations for which the formal error bounds are low, and we analyse first experiments with these algorithms on different models. △ Less

Submitted 24 April, 2024; v1 submitted 12 March, 2024; originally announced March 2024.

Comments: 36 pages

MSC Class: 60J22 ACM Class: G.3

Rate Lifting for Stochastic Process Algebra: Exploiting Structural Properties

Authors: Markus Siegle, Amin Soltanieh

Abstract: This report presents an algorithm for determining the unknown rates in the sequential processes of a Stochastic Process Algebra model, provided that the rates in the combined flat model are given. Such a rate lifting is useful for model reengineering and model repair. Technically, the algorithm works by solving systems of nonlinear equations and, if necessary, adjusting the model`s synchronisation… ▽ More This report presents an algorithm for determining the unknown rates in the sequential processes of a Stochastic Process Algebra model, provided that the rates in the combined flat model are given. Such a rate lifting is useful for model reengineering and model repair. Technically, the algorithm works by solving systems of nonlinear equations and, if necessary, adjusting the model`s synchronisation structure without changing its transition system. This report contains the complete pseudo-code of the algorithm. The approach taken by the algorithm exploits some structural properties of Stochastic Process Algebra systems, which are formulated here for the first time and could be very beneficial also in other contexts. △ Less

Submitted 29 June, 2022; originally announced June 2022.

Rate Reduction for State-labelled Markov Chains with Upper Time-bounded CSL Requirements

Authors: Bharath Siva Kumar Tati, Markus Siegle

Abstract: This paper presents algorithms for identifying and reducing a dedicated set of controllable transition rates of a state-labelled continuous-time Markov chain model. The purpose of the reduction is to make states to satisfy a given requirement, specified as a CSL upper time-bounded Until formula. We distinguish two different cases, depending on the type of probability bound. A natural partitioning… ▽ More This paper presents algorithms for identifying and reducing a dedicated set of controllable transition rates of a state-labelled continuous-time Markov chain model. The purpose of the reduction is to make states to satisfy a given requirement, specified as a CSL upper time-bounded Until formula. We distinguish two different cases, depending on the type of probability bound. A natural partitioning of the state space allows us to develop possible solutions, leading to simple algorithms for both cases. △ Less

Submitted 1 August, 2016; originally announced August 2016.

Comments: In Proceedings Cassting'16/SynCoP'16, arXiv:1608.00177

ACM Class: D.2.4; G.3; C.4

Journal ref: EPTCS 220, 2016, pp. 77-89

Lattice structures for bisimilar Probabilistic Automata

Authors: Johann Schuster, Markus Siegle

Abstract: The paper shows that there is a deep structure on certain sets of bisimilar Probabilistic Automata (PA). The key prerequisite for these structures is a notion of compactness of PA. It is shown that compact bisimilar PA form lattices. These results are then used in order to establish normal forms not only for finite automata, but also for infinite automata, as long as they are compact. The paper shows that there is a deep structure on certain sets of bisimilar Probabilistic Automata (PA). The key prerequisite for these structures is a notion of compactness of PA. It is shown that compact bisimilar PA form lattices. These results are then used in order to establish normal forms not only for finite automata, but also for infinite automata, as long as they are compact. △ Less

Submitted 26 February, 2014; originally announced February 2014.

Comments: In Proceedings INFINITY 2013, arXiv:1402.6610

Journal ref: EPTCS 140, 2014, pp. 1-15

Markov Automata: Deciding Weak Bisimulation by means of non-naively Vanishing States

Authors: Johann Schuster, Markus Siegle

Abstract: This paper develops a decision algorithm for weak bisimulation on Markov Automata (MA). For that purpose, different notions of vanishing state (a concept known from the area of Generalised Stochastic Petri Nets) are defined. Vanishing states are shown to be essential for relating the concepts of (state-based) naive weak bisimulation and (distribution-based) weak bisimulation. The bisimulation algo… ▽ More This paper develops a decision algorithm for weak bisimulation on Markov Automata (MA). For that purpose, different notions of vanishing state (a concept known from the area of Generalised Stochastic Petri Nets) are defined. Vanishing states are shown to be essential for relating the concepts of (state-based) naive weak bisimulation and (distribution-based) weak bisimulation. The bisimulation algorithm presented here follows the partition-refinement scheme and has exponential time complexity. △ Less

Submitted 30 April, 2014; v1 submitted 28 May, 2012; originally announced May 2012.

Comments: Main results stay the same as in the previous versions, but the proofs have completely changed

MSC Class: 03-02