-
MCMC with Strings and Branes: The Suburban Algorithm
Authors:
Jonathan J. Heckman,
Jeffrey G. Bernstein,
Ben Vigoda
Abstract:
Motivated by the physics of strings and branes, we introduce a general suite of Markov chain Monte Carlo (MCMC) "suburban samplers" (i.e., spread out Metropolis). The suburban algorithm involves an ensemble of statistical agents connected together by a random network. Performance of the collective in reaching a fast and accurate inference depends primarily on the average number of nearest neighbor…
▽ More
Motivated by the physics of strings and branes, we introduce a general suite of Markov chain Monte Carlo (MCMC) "suburban samplers" (i.e., spread out Metropolis). The suburban algorithm involves an ensemble of statistical agents connected together by a random network. Performance of the collective in reaching a fast and accurate inference depends primarily on the average number of nearest neighbor connections. Increasing the average number of neighbors above zero initially leads to an increase in performance, though there is a critical connectivity with effective dimension d_eff ~ 1, above which "groupthink" takes over, and the performance of the sampler declines.
△ Less
Submitted 19 May, 2016;
originally announced May 2016.
-
MCMC with Strings and Branes: The Suburban Algorithm (Extended Version)
Authors:
Jonathan J. Heckman,
Jeffrey G. Bernstein,
Ben Vigoda
Abstract:
Motivated by the physics of strings and branes, we develop a class of Markov chain Monte Carlo (MCMC) algorithms involving extended objects. Starting from a collection of parallel Metropolis-Hastings (MH) samplers, we place them on an auxiliary grid, and couple them together via nearest neighbor interactions. This leads to a class of "suburban samplers" (i.e., spread out Metropolis). Coupling the…
▽ More
Motivated by the physics of strings and branes, we develop a class of Markov chain Monte Carlo (MCMC) algorithms involving extended objects. Starting from a collection of parallel Metropolis-Hastings (MH) samplers, we place them on an auxiliary grid, and couple them together via nearest neighbor interactions. This leads to a class of "suburban samplers" (i.e., spread out Metropolis). Coupling the samplers in this way modifies the mixing rate and speed of convergence for the Markov chain, and can in many cases allow a sampler to more easily overcome free energy barriers in a target distribution. We test these general theoretical considerations by performing several numerical experiments. For suburban samplers with a fluctuating grid topology, performance is strongly correlated with the average number of neighbors. Increasing the average number of neighbors above zero initially leads to an increase in performance, though there is a critical connectivity with effective dimension d_eff ~ 1, above which "groupthink" takes over, and the performance of the sampler declines.
△ Less
Submitted 8 September, 2017; v1 submitted 17 May, 2016;
originally announced May 2016.
-
Compressive sensing for dynamic spectrum access networks: Techniques and tradeoffs
Authors:
J. N. Laska,
W. F. Bradley,
T. W. Rondeau,
K. E. Nolan,
B. Vigoda
Abstract:
We explore the practical costs and benefits of CS for dynamic spectrum access (DSA) networks. Firstly, we review several fast and practical techniques for energy detection without full reconstruction and provide theoretical guarantees. We also define practical metrics to measure the performance of these techniques. Secondly, we perform comprehensive experiments comparing the techniques on real sig…
▽ More
We explore the practical costs and benefits of CS for dynamic spectrum access (DSA) networks. Firstly, we review several fast and practical techniques for energy detection without full reconstruction and provide theoretical guarantees. We also define practical metrics to measure the performance of these techniques. Secondly, we perform comprehensive experiments comparing the techniques on real signals captured over the air. Our results show that we can significantly compressively acquire the signal while still accurately determining spectral occupancy.
△ Less
Submitted 10 February, 2014;
originally announced February 2014.
-
Accelerating Inference: towards a full Language, Compiler and Hardware stack
Authors:
Shawn Hershey,
Jeff Bernstein,
Bill Bradley,
Andrew Schweitzer,
Noah Stein,
Theo Weber,
Ben Vigoda
Abstract:
We introduce Dimple, a fully open-source API for probabilistic modeling. Dimple allows the user to specify probabilistic models in the form of graphical models, Bayesian networks, or factor graphs, and performs inference (by automatically deriving an inference engine from a variety of algorithms) on the model. Dimple also serves as a compiler for GP5, a hardware accelerator for inference.
We introduce Dimple, a fully open-source API for probabilistic modeling. Dimple allows the user to specify probabilistic models in the form of graphical models, Bayesian networks, or factor graphs, and performs inference (by automatically deriving an inference engine from a variety of algorithms) on the model. Dimple also serves as a compiler for GP5, a hardware accelerator for inference.
△ Less
Submitted 12 December, 2012;
originally announced December 2012.
-
Reweighted LP Decoding for LDPC Codes
Authors:
Amin Khajehnejad,
Alexandros G. Dimakis,
Babak Hassibi,
Benjamin Vigoda,
William Bradley
Abstract:
We introduce a novel algorithm for decoding binary linear codes by linear programming. We build on the LP decoding algorithm of Feldman et al. and introduce a post-processing step that solves a second linear program that reweights the objective function based on the outcome of the original LP decoder output. Our analysis shows that for some LDPC ensembles we can improve the provable threshold guar…
▽ More
We introduce a novel algorithm for decoding binary linear codes by linear programming. We build on the LP decoding algorithm of Feldman et al. and introduce a post-processing step that solves a second linear program that reweights the objective function based on the outcome of the original LP decoder output. Our analysis shows that for some LDPC ensembles we can improve the provable threshold guarantees compared to standard LP decoding. We also show significant empirical performance gains for the reweighted LP decoding algorithm with very small additional computational complexity.
△ Less
Submitted 14 March, 2011;
originally announced March 2011.
