-
Double-cover-based analysis of the Bethe permanent of non-negative matrices
Authors:
Kit Shing Ng,
Pascal O. Vontobel
Abstract:
The permanent of a non-negative matrix appears naturally in many information processing scenarios. Because of the intractability of the permanent beyond small matrices, various approximation techniques have been developed in the past. In this paper, we study the Bethe approximation of the permanent and add to the body of literature showing that this approximation is very well behaved in many respe…
▽ More
The permanent of a non-negative matrix appears naturally in many information processing scenarios. Because of the intractability of the permanent beyond small matrices, various approximation techniques have been developed in the past. In this paper, we study the Bethe approximation of the permanent and add to the body of literature showing that this approximation is very well behaved in many respects. Our main technical tool are topological double covers of the normal factor graph whose partition function equals the permanent of interest, along with a transformation of these double covers.
△ Less
Submitted 30 May, 2022;
originally announced May 2022.
-
Local dimensions of measures of finite type II - Measures without full support and with non-regular probabilities
Authors:
Kathryn E. Hare,
Kevin G. Hare,
Michael Ka Shing Ng
Abstract:
Consider a sequence of linear contractions $S_{j}(x)=\varrho x+d_{j}$ and probabilities $p_{j}>0$ with $\sum p_{j}=1$. We are interested in the self-similar measure $μ=\sum p_{j}μ\circ S_{j}^{-1}$, of finite type. In this paper we study the multi-fractal analysis of such measures, extending the theory to measures arising from non-regular probabilities and whose support is not necessarily an interv…
▽ More
Consider a sequence of linear contractions $S_{j}(x)=\varrho x+d_{j}$ and probabilities $p_{j}>0$ with $\sum p_{j}=1$. We are interested in the self-similar measure $μ=\sum p_{j}μ\circ S_{j}^{-1}$, of finite type. In this paper we study the multi-fractal analysis of such measures, extending the theory to measures arising from non-regular probabilities and whose support is not necessarily an interval.
Under some mild technical assumptions, we prove that there exists a subset of supp$μ$ of full $μ$ and Hausdorff measure, called the truly essential class, for which the set of (upper or lower) local dimensions is a closed interval. Within the truly essential class we show that there exists a point with local dimension exactly equal to the dimension of the support. We give an example where the set of local dimensions is a two element set, with all the elements of the truly essential class giving the same local dimension. We give general criteria for these measures to be absolutely continuous with respect to the associated Hausdorff measure of their support and we show that the dimension of the support can be computed using only information about the essential class.
To conclude, we present a detailed study of three examples. First, we show that the set of local dimensions of the biased Bernoulli convolution with contraction ratio the inverse of a simple Pisot number always admits an isolated point. We give a precise description of the essential class of a generalized Cantor set of finite type. Lastly, we study a maximal loop class that is not truly essential.
△ Less
Submitted 7 March, 2016;
originally announced March 2016.
-
Probabilities on Sentences in an Expressive Logic
Authors:
Marcus Hutter,
John W. Lloyd,
Kee Siong Ng,
William T. B. Uther
Abstract:
Automated reasoning about uncertain knowledge has many applications. One difficulty when develo** such systems is the lack of a completely satisfactory integration of logic and probability. We address this problem directly. Expressive languages like higher-order logic are ideally suited for representing and reasoning about structured knowledge. Uncertain knowledge can be modeled by using graded…
▽ More
Automated reasoning about uncertain knowledge has many applications. One difficulty when develo** such systems is the lack of a completely satisfactory integration of logic and probability. We address this problem directly. Expressive languages like higher-order logic are ideally suited for representing and reasoning about structured knowledge. Uncertain knowledge can be modeled by using graded probabilities rather than binary truth-values. The main technical problem studied in this paper is the following: Given a set of sentences, each having some probability of being true, what probability should be ascribed to other (query) sentences? A natural wish-list, among others, is that the probability distribution (i) is consistent with the knowledge base, (ii) allows for a consistent inference procedure and in particular (iii) reduces to deductive logic in the limit of probabilities being 0 and 1, (iv) allows (Bayesian) inductive reasoning and (v) learning in the limit and in particular (vi) allows confirmation of universally quantified hypotheses/sentences. We translate this wish-list into technical requirements for a prior probability and show that probabilities satisfying all our criteria exist. We also give explicit constructions and several general characterizations of probabilities that satisfy some or all of the criteria and various (counter) examples. We also derive necessary and sufficient conditions for extending beliefs about finitely many sentences to suitable probabilities over all sentences, and in particular least dogmatic or least biased ones. We conclude with a brief outlook on how the developed theory might be used and approximated in autonomous reasoning agents. Our theory is a step towards a globally consistent and empirically satisfactory unification of probability and logic.
△ Less
Submitted 12 September, 2012;
originally announced September 2012.
