-
Row-Centric Lossless Compression of Markov Images
Authors:
Matthew G. Reyes,
David L. Neuhoff
Abstract:
Motivated by the question of whether the recently introduced Reduced Cutset Coding (RCC) offers rate-complexity performance benefits over conventional context-based conditional coding for sources with two-dimensional Markov structure, this paper compares several row-centric coding strategies that vary in the amount of conditioning as well as whether a model or an empirical table is used in the enc…
▽ More
Motivated by the question of whether the recently introduced Reduced Cutset Coding (RCC) offers rate-complexity performance benefits over conventional context-based conditional coding for sources with two-dimensional Markov structure, this paper compares several row-centric coding strategies that vary in the amount of conditioning as well as whether a model or an empirical table is used in the encoding of blocks of rows. The conclusion is that, at least for sources exhibiting low-order correlations, 1-sided model-based conditional coding is superior to the method of RCC for a given constraint on complexity, and conventional context-based conditional coding is nearly as good as the 1-sided model-based coding.
△ Less
Submitted 26 February, 2017;
originally announced February 2017.
-
Correct Convergence of Min-Sum Loopy Belief Propagation in a Block Interpolation Problem
Authors:
Yutong Wang,
Matthew G. Reyes,
David L. Neuhoff
Abstract:
This work proves a new result on the correct convergence of Min-Sum Loopy Belief Propagation (LBP) in an interpolation problem on a square grid graph. The focus is on the notion of local solutions, a numerical quantity attached to each site of the graph that can be used for obtaining MAP estimates. The main result is that over an $N\times N$ grid graph with a one-run boundary configuration, the lo…
▽ More
This work proves a new result on the correct convergence of Min-Sum Loopy Belief Propagation (LBP) in an interpolation problem on a square grid graph. The focus is on the notion of local solutions, a numerical quantity attached to each site of the graph that can be used for obtaining MAP estimates. The main result is that over an $N\times N$ grid graph with a one-run boundary configuration, the local solutions at each $i \in B$ can be calculated using Min-Sum LBP by passing difference messages in $2N$ iterations, which parallels the well-known convergence time in trees.
△ Less
Submitted 22 January, 2017;
originally announced February 2017.
-
Cutset Width and Spacing for Reduced Cutset Coding of Markov Random Fields
Authors:
Matthew G. Reyes,
David L. Neuhoff
Abstract:
In this paper we explore tradeoffs, regarding coding performance, between the thickness and spacing of the cutset used in Reduced Cutset Coding (RCC) of a Markov random field image model. Considering MRF models on a square lattice of sites, we show that under a stationarity condition, increasing the thickness of the cutset reduces coding rate for the cutset, increasing the spacing between componen…
▽ More
In this paper we explore tradeoffs, regarding coding performance, between the thickness and spacing of the cutset used in Reduced Cutset Coding (RCC) of a Markov random field image model. Considering MRF models on a square lattice of sites, we show that under a stationarity condition, increasing the thickness of the cutset reduces coding rate for the cutset, increasing the spacing between components of the cutset increases the coding rate of the non-cutset pixels, though the coding rate of the latter is always strictly less than that of the former. We show that the redundancy of RCC can be decomposed into two terms, a correlation redundancy due to coding the components of the cutset independently, and a distribution redundancy due to coding the cutset as a reduced MRF. We provide analysis of these two sources of redundancy. We present results from numerical simulations with a homogeneous Ising model that bear out the analytical results. We also present a consistent estimation algorithm for the moment-matching reduced MRF on the cutset.
△ Less
Submitted 23 February, 2016; v1 submitted 15 February, 2016;
originally announced February 2016.
-
Minimum Conditional Description Length Estimation for Markov Random Fields
Authors:
Matthew G. Reyes,
David L. Neuhoff
Abstract:
In this paper we discuss a method, which we call Minimum Conditional Description Length (MCDL), for estimating the parameters of a subset of sites within a Markov random field. We assume that the edges are known for the entire graph $G=(V,E)$. Then, for a subset $U\subset V$, we estimate the parameters for nodes and edges in $U$ as well as for edges incident to a node in $U$, by finding the expone…
▽ More
In this paper we discuss a method, which we call Minimum Conditional Description Length (MCDL), for estimating the parameters of a subset of sites within a Markov random field. We assume that the edges are known for the entire graph $G=(V,E)$. Then, for a subset $U\subset V$, we estimate the parameters for nodes and edges in $U$ as well as for edges incident to a node in $U$, by finding the exponential parameter for that subset that yields the best compression conditioned on the values on the boundary $\partial U$. Our estimate is derived from a temporally stationary sequence of observations on the set $U$. We discuss how this method can also be applied to estimate a spatially invariant parameter from a single configuration, and in so doing, derive the Maximum Pseudo-Likelihood (MPL) estimate.
△ Less
Submitted 23 February, 2016; v1 submitted 9 February, 2016;
originally announced February 2016.
-
Multidimensional Manhattan Sampling and Reconstruction
Authors:
Matthew A. Prelee,
David L. Neuhoff
Abstract:
This paper introduces Manhattan sampling in two and higher dimensions, and proves sampling theorems. In two dimensions, Manhattan sampling, which takes samples densely along a Manhattan grid of lines, can be viewed as sampling on the union of two rectangular lattices, one dense horizontally, being a multiple of the fine spacing of the other. The sampling theorem shows that images bandlimited to th…
▽ More
This paper introduces Manhattan sampling in two and higher dimensions, and proves sampling theorems. In two dimensions, Manhattan sampling, which takes samples densely along a Manhattan grid of lines, can be viewed as sampling on the union of two rectangular lattices, one dense horizontally, being a multiple of the fine spacing of the other. The sampling theorem shows that images bandlimited to the union of the Nyquist regions of the two rectangular lattices can be recovered from their Manhattan samples, and an efficient procedure for doing so is given. Such recovery is possible even though there is overlap among the spectral replicas induced by Manhattan sampling.
In three and higher dimensions, there are many possible configurations for Manhattan sampling, each consisting of the union of special rectangular lattices called bi-step lattices. This paper identifies them, proves a sampling theorem showing that images bandlimited to the union of the Nyquist regions of the bi-step rectangular lattices are recoverable from Manhattan samples, and presents an efficient onion-peeling procedure for doing so. Furthermore, it develops a special representation for the bi-step lattices and an algebra with nice properties. It is also shown that the set of reconstructable images is maximal in the Landau sense.
While most of the paper deals with continuous-space images, Manhattan sampling of discrete-space images is also considered, for infinite, as well as finite, support images.
△ Less
Submitted 5 February, 2015;
originally announced February 2015.
-
Throughput Scaling in Random Wireless Networks: A Non-Hierarchical Multipath Routing Strategy
Authors:
Awlok Josan,
Mingyan Liu,
David L. Neuhoff,
S. Sandeep Pradhan
Abstract:
Franceschetti et al. have recently shown that per-node throughput in an extended, ad hoc wireless network with $Θ(n)$ randomly distributed nodes and multihop routing can be increased from the $Ω({1 \over \sqrt{n} \log n})$ scaling demonstrated in the seminal paper of Gupta and Kumar to $Ω({1 \over \sqrt{n}})$. The goal of the present paper is to understand the dependence of this interesting resu…
▽ More
Franceschetti et al. have recently shown that per-node throughput in an extended, ad hoc wireless network with $Θ(n)$ randomly distributed nodes and multihop routing can be increased from the $Ω({1 \over \sqrt{n} \log n})$ scaling demonstrated in the seminal paper of Gupta and Kumar to $Ω({1 \over \sqrt{n}})$. The goal of the present paper is to understand the dependence of this interesting result on the principal new features it introduced relative to Gupta-Kumar: (1) a capacity-based formula for link transmission bit-rates in terms of received signal-to-interference-and-noise ratio (SINR); (2) hierarchical routing from sources to destinations through a system of communal highways; and (3) cell-based routes constructed by percolation. The conclusion of the present paper is that the improved throughput scaling is principally due to the percolation-based routing, which enables shorter hops and, consequently, less interference. This is established by showing that throughput $Ω({1 \over \sqrt{n}})$ can be attained by a system that does not employ highways, but instead uses percolation to establish, for each source-destination pair, a set of $Θ(\log n)$ routes within a narrow routing corridor running from source to destination. As a result, highways are not essential. In addition, it is shown that throughput $Ω({1 \over \sqrt{n}})$ can be attained with the original threshold transmission bit-rate model, provided that node transmission powers are permitted to grow with $n$. Thus, the benefit of the capacity bit-rate model is simply to permit the power to remain bounded, even as the network expands.
△ Less
Submitted 8 October, 2007;
originally announced October 2007.
-
On Throughput Scaling of Wireless Networks: Effect of Node Density and Propagation Model
Authors:
Enrique J. Duarte-Melo,
Awlok Josan,
Mingyan Liu,
David L. Neuhoff,
Sandeep Pradhan
Abstract:
This paper derives a lower bound to the per-node throughput achievable by a wireless network when n source-destination pairs are randomly distributed throughout a disk of radius $n^γ$, $ γ\geq 0$, propagation is modeled by attenuation of the form $1/(1+d)^α$, $α>2$, and successful transmission occurs at a fixed rate W when received signal to noise and interference ratio is greater than some thre…
▽ More
This paper derives a lower bound to the per-node throughput achievable by a wireless network when n source-destination pairs are randomly distributed throughout a disk of radius $n^γ$, $ γ\geq 0$, propagation is modeled by attenuation of the form $1/(1+d)^α$, $α>2$, and successful transmission occurs at a fixed rate W when received signal to noise and interference ratio is greater than some threshold $β$, and at rate 0 otherwise. The lower bound has the form $n^{1-γ}$ when $γ< 1/2$, and $(n \ln n)^{-1/2}$ when $γ\geq 1/2$. The methods are similar to, but somewhat simpler than, those in the seminal paper by Gupta and Kumar.
△ Less
Submitted 30 July, 2007;
originally announced July 2007.
