Showing 1–50 of 102 results for author: Forbes, M

Nonlinear Interactions of Planetary-Scale Waves in Mesospheric Winds Observed at 52°N Latitude and Two Longitudes

Authors: Maosheng He, Jeffrey M. Forbes, Gunter Stober, Christoph Jacobi, Guozhu Li, Libo Liu, Jiyao Xu

Abstract: Nine years of mesospheric wind data from two meteor radars at 52°N latitude were analyzed to investigate planetary waves (PWs) and tides by estimating their zonal wavenumber through longitudinal phase differences. Our results reveal that PW normal modes (NMs) primarily drive multi-day oscillations, showing seasonal variability and statistical associations with Sudden Stratospheric Warming (SSW) ev… ▽ More Nine years of mesospheric wind data from two meteor radars at 52°N latitude were analyzed to investigate planetary waves (PWs) and tides by estimating their zonal wavenumber through longitudinal phase differences. Our results reveal that PW normal modes (NMs) primarily drive multi-day oscillations, showing seasonal variability and statistical associations with Sudden Stratospheric Warming (SSW) events. Specifically, a significant 6-day NM emerges in April, followed by predominant 4- and 2-day NMs until June, with peaks of 2-, 4-, and 6-day NMs spanning July to October. Furthermore, our study provides the first observational verification of frequency and zonal wavenumber of over ten secondary waves from nonlinear interactions among planetary-scale waves. One notable finding is the prevalence of non-migrating components in winter 24-hour and summer 8-hour tides, attributed to these nonlinear interactions. Our findings underscore the diverse nonlinear dynamics of planetary-scale waves, triggering a variety of periodic oscillations. △ Less

Submitted 11 June, 2024; v1 submitted 9 June, 2024; originally announced June 2024.

Deep Hankel matrices with random elements

Authors: Nathan P. Lawrence, Philip D. Loewen, Shuyuan Wang, Michael G. Forbes, R. Bhushan Gopaluni

Abstract: Willems' fundamental lemma enables a trajectory-based characterization of linear systems through data-based Hankel matrices. However, in the presence of measurement noise, we ask: Is this noisy Hankel-based model expressive enough to re-identify itself? In other words, we study the output prediction accuracy from recursively applying the same persistently exciting input sequence to the model. We f… ▽ More Willems' fundamental lemma enables a trajectory-based characterization of linear systems through data-based Hankel matrices. However, in the presence of measurement noise, we ask: Is this noisy Hankel-based model expressive enough to re-identify itself? In other words, we study the output prediction accuracy from recursively applying the same persistently exciting input sequence to the model. We find an asymptotic connection to this self-consistency question in terms of the amount of data. More importantly, we also connect this question to the depth (number of rows) of the Hankel model, showing the simple act of reconfiguring a finite dataset significantly improves accuracy. We apply these insights to find a parsimonious depth for LQR problems over the trajectory space. △ Less

Submitted 23 April, 2024; originally announced April 2024.

Comments: L4DC 2024

Stabilizing reinforcement learning control: A modular framework for optimizing over all stable behavior

Authors: Nathan P. Lawrence, Philip D. Loewen, Shuyuan Wang, Michael G. Forbes, R. Bhushan Gopaluni

Abstract: We propose a framework for the design of feedback controllers that combines the optimization-driven and model-free advantages of deep reinforcement learning with the stability guarantees provided by using the Youla-Kucera parameterization to define the search domain. Recent advances in behavioral systems allow us to construct a data-driven internal model; this enables an alternative realization of… ▽ More We propose a framework for the design of feedback controllers that combines the optimization-driven and model-free advantages of deep reinforcement learning with the stability guarantees provided by using the Youla-Kucera parameterization to define the search domain. Recent advances in behavioral systems allow us to construct a data-driven internal model; this enables an alternative realization of the Youla-Kucera parameterization based entirely on input-output exploration data. Perhaps of independent interest, we formulate and analyze the stability of such data-driven models in the presence of noise. The Youla-Kucera approach requires a stable "parameter" for controller design. For the training of reinforcement learning agents, the set of all stable linear operators is given explicitly through a matrix factorization approach. Moreover, a nonlinear extension is given using a neural network to express a parameterized set of stable operators, which enables seamless integration with standard deep learning libraries. Finally, we show how these ideas can also be applied to tune fixed-structure controllers. △ Less

Submitted 21 March, 2024; v1 submitted 21 October, 2023; originally announced October 2023.

Comments: Postprint; 31 pages. arXiv admin note: text overlap with arXiv:2304.03422

Journal ref: Automatica 2024

Fermionic Quantum Turbulence: Pushing the Limits of High-Performance Computing

Authors: Gabriel Wlazlowski, Michael McNeil Forbes, Saptarshi Rajan Sarkar, Andreas Marek, Maciej Szpindler

Abstract: Ultracold atoms provide a platform for analog quantum computer capable of simulating the quantum turbulence that underlies puzzling phenomena like pulsar glitches in rapidly spinning neutron stars. Unlike other platforms like liquid helium, ultracold atoms have a viable theoretical framework for dynamics, but simulations push the edge of current classical computers. We present the largest simulati… ▽ More Ultracold atoms provide a platform for analog quantum computer capable of simulating the quantum turbulence that underlies puzzling phenomena like pulsar glitches in rapidly spinning neutron stars. Unlike other platforms like liquid helium, ultracold atoms have a viable theoretical framework for dynamics, but simulations push the edge of current classical computers. We present the largest simulations of fermionic quantum turbulence to date and explain the computing technology needed, especially improvements in the ELPA library that enable us to diagonalize matrices of record size (millions by millions). We quantify how dissipation and thermalization proceed in fermionic quantum turbulence by using the internal structure of vortices as a new probe of the local effective temperature. All simulation data and source codes are made available to facilitate rapid scientific progress in the field of ultracold Fermi gases. △ Less

Submitted 17 May, 2024; v1 submitted 5 October, 2023; originally announced October 2023.

Comments: 13 pages, 9 figures

Journal ref: PNAS Nexus 3, pgae160 (2024)

Active Set methods for solving large sample average approximations of chance constrained optimisation problems

Authors: Rick Jeuken, Michael Forbes

Abstract: This article describes a novel approach to chance-constrained programming based on the sample average approximation (SAA) method. Recent work focuses on heuristic approximations to the SAA problem and we introduce a novel approach which improves on some existing methods. Our Active Set method allows one to solve SAAs of chance-constrained programs with very large numbers of scenarios quickly. We d… ▽ More This article describes a novel approach to chance-constrained programming based on the sample average approximation (SAA) method. Recent work focuses on heuristic approximations to the SAA problem and we introduce a novel approach which improves on some existing methods. Our Active Set method allows one to solve SAAs of chance-constrained programs with very large numbers of scenarios quickly. We demonstrate that increasing the number of scenarios is more important than improving accuracy with small numbers of scenarios. We use an example of the portfolio selection problem to demonstrate the relative performance of previous and new methods. Extending the Active Set method to an integer-programming model further highlights its applicability and further improves over previous approaches. △ Less

Submitted 23 July, 2023; originally announced July 2023.

Comments: 26 pages, 7 figures, This paper sets forth the material presented at the Decision Making Under Uncertainty workshop held at the University of Queensland, 11 July 2022

Framework for Multi-messenger Inference from Neutron Stars: Combining Nuclear Theory Priors

Authors: Praveer Tiwari, Dake Zhou, Bhaskar Biswas, Michael McNeil Forbes, Sukanta Bose

Abstract: We construct an efficient parameterization of the pure neutron-matter equation of state (EoS) that incorporates the uncertainties from both chiral effective field theory ($χ$EFT) and phenomenological potential calculations. This parameterization yields a family of EoSs including and extending the forms based purely on these two calculations. In combination with an agnostic inner core EoS, this par… ▽ More We construct an efficient parameterization of the pure neutron-matter equation of state (EoS) that incorporates the uncertainties from both chiral effective field theory ($χ$EFT) and phenomenological potential calculations. This parameterization yields a family of EoSs including and extending the forms based purely on these two calculations. In combination with an agnostic inner core EoS, this parameterization is used in a Bayesian inference pipeline to obtain constraints on the e os parameters using multi-messenger observations of neutron stars. We specifically considered observations of the massive pulsar J0740+6620, the binary neutron star coalescence GW170817, and the NICER pulsar J0030+0451. Constraints on neutron star mass-radius relations are obtained and compared. The Bayes factors for the different EoS models are also computed. While current constraints do not reveal any significant preference among these models, the framework developed here may enable future observations with more sensitive detectors to discriminate them. △ Less

Submitted 25 June, 2024; v1 submitted 7 June, 2023; originally announced June 2023.

Report number: LIGO-P2300061

Reinforcement Learning with Partial Parametric Model Knowledge

Authors: Shuyuan Wang, Philip D. Loewen, Nathan P. Lawrence, Michael G. Forbes, R. Bhushan Gopaluni

Abstract: We adapt reinforcement learning (RL) methods for continuous control to bridge the gap between complete ignorance and perfect knowledge of the environment. Our method, Partial Knowledge Least Squares Policy Iteration (PLSPI), takes inspiration from both model-free RL and model-based control. It uses incomplete information from a partial model and retains RL's data-driven adaption towards optimal pe… ▽ More We adapt reinforcement learning (RL) methods for continuous control to bridge the gap between complete ignorance and perfect knowledge of the environment. Our method, Partial Knowledge Least Squares Policy Iteration (PLSPI), takes inspiration from both model-free RL and model-based control. It uses incomplete information from a partial model and retains RL's data-driven adaption towards optimal performance. The linear quadratic regulator provides a case study; numerical experiments demonstrate the effectiveness and resulting benefits of the proposed method. △ Less

Submitted 25 April, 2023; originally announced April 2023.

Comments: IFAC World Congress 2023

Journal ref: IFAC-PapersOnLine 2023

A modular framework for stabilizing deep reinforcement learning control

Authors: Nathan P. Lawrence, Philip D. Loewen, Shuyuan Wang, Michael G. Forbes, R. Bhushan Gopaluni

Abstract: We propose a framework for the design of feedback controllers that combines the optimization-driven and model-free advantages of deep reinforcement learning with the stability guarantees provided by using the Youla-Kucera parameterization to define the search domain. Recent advances in behavioral systems allow us to construct a data-driven internal model; this enables an alternative realization of… ▽ More We propose a framework for the design of feedback controllers that combines the optimization-driven and model-free advantages of deep reinforcement learning with the stability guarantees provided by using the Youla-Kucera parameterization to define the search domain. Recent advances in behavioral systems allow us to construct a data-driven internal model; this enables an alternative realization of the Youla-Kucera parameterization based entirely on input-output exploration data. Using a neural network to express a parameterized set of nonlinear stable operators enables seamless integration with standard deep learning libraries. We demonstrate the approach on a realistic simulation of a two-tank system. △ Less

Submitted 6 April, 2023; originally announced April 2023.

Comments: IFAC World Congress 2023

Journal ref: IFAC-PapersOnLine 2023

Meta-Reinforcement Learning for Adaptive Control of Second Order Systems

Authors: Daniel G. McClement, Nathan P. Lawrence, Michael G. Forbes, Philip D. Loewen, Johan U. Backström, R. Bhushan Gopaluni

Abstract: Meta-learning is a branch of machine learning which aims to synthesize data from a distribution of related tasks to efficiently solve new ones. In process control, many systems have similar and well-understood dynamics, which suggests it is feasible to create a generalizable controller through meta-learning. In this work, we formulate a meta reinforcement learning (meta-RL) control strategy that t… ▽ More Meta-learning is a branch of machine learning which aims to synthesize data from a distribution of related tasks to efficiently solve new ones. In process control, many systems have similar and well-understood dynamics, which suggests it is feasible to create a generalizable controller through meta-learning. In this work, we formulate a meta reinforcement learning (meta-RL) control strategy that takes advantage of known, offline information for training, such as a model structure. The meta-RL agent is trained over a distribution of model parameters, rather than a single model, enabling the agent to automatically adapt to changes in the process dynamics while maintaining performance. A key design element is the ability to leverage model-based information offline during training, while maintaining a model-free policy structure for interacting with new environments. Our previous work has demonstrated how this approach can be applied to the industrially-relevant problem of tuning proportional-integral controllers to control first order processes. In this work, we briefly reintroduce our methodology and demonstrate how it can be extended to proportional-integral-derivative controllers and second order systems. △ Less

Submitted 19 September, 2022; originally announced September 2022.

Comments: AdCONIP 2022. arXiv admin note: substantial text overlap with arXiv:2203.09661

Logic-Based benders Decomposition for Wildfire Suppression

Authors: Mitchell G Harris, Michael A Forbes, Thomas Taimre

Abstract: We study the problem of locating fire suppression resources in a burning landscape in order to minimise the total area burned. The landscape is modelled as a directed graph, with nodes representing regions of the landscape, and arcs representing adjacency relationships. The fire spread is modelled using the minimum travel time principle. We propose a non-linear integer programming formulation and… ▽ More We study the problem of locating fire suppression resources in a burning landscape in order to minimise the total area burned. The landscape is modelled as a directed graph, with nodes representing regions of the landscape, and arcs representing adjacency relationships. The fire spread is modelled using the minimum travel time principle. We propose a non-linear integer programming formulation and an exact solution approach utilising logic-based Benders decomposition. We benchmark the approach against a mixed integer program and an iterated local search metaheuristic from the literature. We are able to solve challenging instances to proven optimality in a reasonable amount of time. △ Less

Submitted 3 September, 2022; originally announced September 2022.

Comments: 24 pages

MSC Class: 90C10; 90C11; 90C27; 90C30; 90C90

Atom Interferometric Imaging of Differential Potentials Using an Atom Laser

Authors: Maren E. Mossman, Ryan A. Corbin, Michael McNeil Forbes, Peter Engels

Abstract: Interferometry is a prime technique for modern precision measurements. Atoms, unlike light, have significant interactions with electric, magnetic, and gravitational fields, making their use in interferometric applications particularly versatile. Here, we demonstrate atom interferometry to image optical and magnetic potential landscapes over an area exceeding $240 μm \times 600 μm$. The differentia… ▽ More Interferometry is a prime technique for modern precision measurements. Atoms, unlike light, have significant interactions with electric, magnetic, and gravitational fields, making their use in interferometric applications particularly versatile. Here, we demonstrate atom interferometry to image optical and magnetic potential landscapes over an area exceeding $240 μm \times 600 μm$. The differential potentials employed in our experiments generate phase imprints in an atom laser that are made visible through a Ramsey pulse sequence. We further demonstrate how advanced pulse sequences can enhance desired imaging features, e.g. to image steep potential gradients. A theoretical discussion is presented that provides a semiclassical analysis and matching numerics. △ Less

Submitted 13 June, 2023; v1 submitted 16 August, 2022; originally announced August 2022.

Comments: Updated to match published version. 13 pages, 9 figures

Meta-Reinforcement Learning for the Tuning of PI Controllers: An Offline Approach

Authors: Daniel G. McClement, Nathan P. Lawrence, Johan U. Backstrom, Philip D. Loewen, Michael G. Forbes, R. Bhushan Gopaluni

Abstract: Meta-learning is a branch of machine learning which trains neural network models to synthesize a wide variety of data in order to rapidly solve new problems. In process control, many systems have similar and well-understood dynamics, which suggests it is feasible to create a generalizable controller through meta-learning. In this work, we formulate a meta reinforcement learning (meta-RL) control s… ▽ More Meta-learning is a branch of machine learning which trains neural network models to synthesize a wide variety of data in order to rapidly solve new problems. In process control, many systems have similar and well-understood dynamics, which suggests it is feasible to create a generalizable controller through meta-learning. In this work, we formulate a meta reinforcement learning (meta-RL) control strategy that can be used to tune proportional--integral controllers. Our meta-RL agent has a recurrent structure that accumulates "context" to learn a system's dynamics through a hidden state variable in closed-loop. This architecture enables the agent to automatically adapt to changes in the process dynamics. In tests reported here, the meta-RL agent was trained entirely offline on first order plus time delay systems, and produced excellent results on novel systems drawn from the same distribution of process dynamics used for training. A key design element is the ability to leverage model-based information offline during training in simulated environments while maintaining a model-free policy structure for interacting with novel processes where there is uncertainty regarding the true process dynamics. Meta-learning is a promising approach for constructing sample-efficient intelligent controllers. △ Less

Submitted 19 September, 2022; v1 submitted 17 March, 2022; originally announced March 2022.

Comments: 23 pages; postprint

Journal ref: Journal of Process Control 2022

Ideals, Determinants, and Straightening: Proving and Using Lower Bounds for Polynomial Ideals

Authors: Robert Andrews, Michael A. Forbes

Abstract: We show that any nonzero polynomial in the ideal generated by the $r \times r$ minors of an $n \times n$ matrix $X$ can be used to efficiently approximate the determinant. For any nonzero polynomial $f$ in this ideal, we construct a small depth-three $f$-oracle circuit that approximates the determinant of size $Θ(r^{1/3})$ in the sense of border complexity. For many classes of algebraic circuits,… ▽ More We show that any nonzero polynomial in the ideal generated by the $r \times r$ minors of an $n \times n$ matrix $X$ can be used to efficiently approximate the determinant. For any nonzero polynomial $f$ in this ideal, we construct a small depth-three $f$-oracle circuit that approximates the determinant of size $Θ(r^{1/3})$ in the sense of border complexity. For many classes of algebraic circuits, this implies that every nonzero polynomial in the ideal generated by $r \times r$ minors is at least as hard to approximately compute as the determinant of size $Θ(r^{1/3})$. We also prove an analogous result for the Pfaffian of a $2n \times 2n$ skew-symmetric matrix and the ideal generated by Pfaffians of $2r \times 2r$ principal submatrices. This answers a recent question of Grochow about complexity in polynomial ideals in the setting of border complexity. We give several applications of our result, two of which are highlighted below. $\bullet$ We prove super-polynomial lower bounds for Ideal Proof System refutations computed by low-depth circuits. This extends the recent breakthrough low-depth circuit lower bounds of Limaye, Srinivasan, and Tavenas to the setting of proof complexity. For many natural circuit classes, we show that the approximative proof complexity of our hard instance is governed by the approximative circuit complexity of the determinant. $\bullet$ We construct new hitting set generators for polynomial-size low-depth circuits. For any $\varepsilon > 0$, we construct generators with seed length $O(n^\varepsilon)$ that attain a near-optimal tradeoff between their seed length and degree, and are computable by low-depth circuits of near-linear size (with respect to the size of their output). This matches the seed length of the generators recently obtained by Limaye, Srinivasan, and Tavenas, but improves on the generator's degree and circuit complexity. △ Less

Submitted 27 October, 2022; v1 submitted 1 December, 2021; originally announced December 2021.

Comments: Abstract shortened to meet arXiv length requirement. v2: Improvements to hitting set generator construction and lower bound for the Ideal Proof System

Detecting Entrainment in Fermi-Bose Mixtures

Authors: Khalid Hossain, Subhadeep Gupta, Michael McNeil Forbes

Abstract: We propose an experimental protocol to directly detect the Andreev-Bashkin effect (entrainment) in the bulk mixture of a bosonic and fermionic superfluid using a ring geometry. Our protocol involves the interferometric detection of the entrainment-induced phase gradient across a superfluid due to the flow of another in which it is immersed. The choice of ring geometry eliminates variations in the… ▽ More We propose an experimental protocol to directly detect the Andreev-Bashkin effect (entrainment) in the bulk mixture of a bosonic and fermionic superfluid using a ring geometry. Our protocol involves the interferometric detection of the entrainment-induced phase gradient across a superfluid due to the flow of another in which it is immersed. The choice of ring geometry eliminates variations in the stronger mean-field interaction which can thwart the detection of entrainment in other geometries. A significant enhancement of the entrainment phase shift signal is possible, if the dimer-boson scattering length turns out to be large, which can be measured by tuning the interaction to the limit of miscibility of the two superfluids. With suggested improvements and careful design implementation, one may achieve $\approx 67$% shift in the interferometer fringes. △ Less

Submitted 24 November, 2021; originally announced November 2021.

Comments: 13 pages, 5 figures

Report number: INT-PUB-21-034

Deep Reinforcement Learning with Shallow Controllers: An Experimental Application to PID Tuning

Authors: Nathan P. Lawrence, Michael G. Forbes, Philip D. Loewen, Daniel G. McClement, Johan U. Backstrom, R. Bhushan Gopaluni

Abstract: Deep reinforcement learning (RL) is an optimization-driven framework for producing control strategies for general dynamical systems without explicit reliance on process models. Good results have been reported in simulation. Here we demonstrate the challenges in implementing a state of the art deep RL algorithm on a real physical system. Aspects include the interplay between software and existing h… ▽ More Deep reinforcement learning (RL) is an optimization-driven framework for producing control strategies for general dynamical systems without explicit reliance on process models. Good results have been reported in simulation. Here we demonstrate the challenges in implementing a state of the art deep RL algorithm on a real physical system. Aspects include the interplay between software and existing hardware; experiment design and sample efficiency; training subject to input constraints; and interpretability of the algorithm and control law. At the core of our approach is the use of a PID controller as the trainable RL policy. In addition to its simplicity, this approach has several appealing features: No additional hardware needs to be added to the control system, since a PID controller can easily be implemented through a standard programmable logic controller; the control law can easily be initialized in a "safe'' region of the parameter space; and the final product -- a well-tuned PID controller -- has a form that practitioners can reason about and deploy with confidence. △ Less

Submitted 13 November, 2021; originally announced November 2021.

Comments: 37 pages; pre-print

Journal ref: Control Engineering Practice 2022

Can Machines Learn Morality? The Delphi Experiment

Authors: Liwei Jiang, Jena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, Jenny Liang, Jesse Dodge, Keisuke Sakaguchi, Maxwell Forbes, Jon Borchardt, Saadia Gabriel, Yulia Tsvetkov, Oren Etzioni, Maarten Sap, Regina Rini, Ye** Choi

Abstract: As AI systems become increasingly powerful and pervasive, there are growing concerns about machines' morality or a lack thereof. Yet, teaching morality to machines is a formidable task, as morality remains among the most intensely debated questions in humanity, let alone for AI. Existing AI systems deployed to millions of users, however, are already making decisions loaded with moral implications,… ▽ More As AI systems become increasingly powerful and pervasive, there are growing concerns about machines' morality or a lack thereof. Yet, teaching morality to machines is a formidable task, as morality remains among the most intensely debated questions in humanity, let alone for AI. Existing AI systems deployed to millions of users, however, are already making decisions loaded with moral implications, which poses a seemingly impossible challenge: teaching machines moral sense, while humanity continues to grapple with it. To explore this challenge, we introduce Delphi, an experimental framework based on deep neural networks trained directly to reason about descriptive ethical judgments, e.g., "hel** a friend" is generally good, while "hel** a friend spread fake news" is not. Empirical results shed novel insights on the promises and limits of machine ethics; Delphi demonstrates strong generalization capabilities in the face of novel ethical situations, while off-the-shelf neural network models exhibit markedly poor judgment including unjust biases, confirming the need for explicitly teaching machines moral sense. Yet, Delphi is not perfect, exhibiting susceptibility to pervasive biases and inconsistencies. Despite that, we demonstrate positive use cases of imperfect Delphi, including using it as a component model within other imperfect AI systems. Importantly, we interpret the operationalization of Delphi in light of prominent ethical theories, which leads us to important future research questions. △ Less

Submitted 12 July, 2022; v1 submitted 14 October, 2021; originally announced October 2021.

Combining Optimisation and Simulation Using Logic-Based Benders Decomposition

Authors: Michael Forbes, Mitchell Harris, Marijn Jansen, Femke van der Schoot, Thomas Taimre

Abstract: Operations research practitioners frequently want to model complicated functions that are are difficult to encode in their underlying optimisation framework. A common approach is to solve an approximate model, and to use a simulation to evaluate the true objective value of one or more solutions. We propose a new approach to integrating simulation into the optimisation model itself. The idea is to… ▽ More Operations research practitioners frequently want to model complicated functions that are are difficult to encode in their underlying optimisation framework. A common approach is to solve an approximate model, and to use a simulation to evaluate the true objective value of one or more solutions. We propose a new approach to integrating simulation into the optimisation model itself. The idea is to run the simulation at each incumbent solution to the master problem. The simulation data is then used to guide the trajectory of the optimisation model itself using logic-based Benders cuts. We test the approach on a class of stochastic resource allocation problems with monotonic performance measures. We derive strong, novel Benders cuts that are provably valid for all problems of the given form. We consider two concrete examples: a nursing home shift scheduling problem, and an airport check in counter allocation problem. While previous papers on these applications could only approximately solve realistic instances, we are able to solve them exactly within a reasonable amount of time. Moreover, while those papers account for the inherent variance of the problem by including estimates of the underlying random variables as model parameters, we are able to compute sample average approximations to optimality with up to 100 scenarios. △ Less

Submitted 5 July, 2022; v1 submitted 18 July, 2021; originally announced July 2021.

Comments: 30 pages

MSC Class: 90C11 (Primary) 90C15; 90C90 (Secondary)

Is GPT-3 Text Indistinguishable from Human Text? Scarecrow: A Framework for Scrutinizing Machine Text

Authors: Yao Dou, Maxwell Forbes, Rik Koncel-Kedziorski, Noah A. Smith, Ye** Choi

Abstract: Modern neural language models can produce remarkably fluent and grammatical text. So much, in fact, that recent work by Clark et al. (2021) has reported that conventional crowdsourcing can no longer reliably distinguish between machine-authored (GPT-3) and human-authored writing. As errors in machine generations become ever subtler and harder to spot, it poses a new challenge to the research commu… ▽ More Modern neural language models can produce remarkably fluent and grammatical text. So much, in fact, that recent work by Clark et al. (2021) has reported that conventional crowdsourcing can no longer reliably distinguish between machine-authored (GPT-3) and human-authored writing. As errors in machine generations become ever subtler and harder to spot, it poses a new challenge to the research community for robust machine text evaluation. We propose a new framework called Scarecrow for scrutinizing machine text via crowd annotation. To support the broad range of real machine errors that can be identified by laypeople, the ten error categories of Scarecrow -- such as redundancy, commonsense errors, and incoherence -- are identified through several rounds of crowd annotation experiments without a predefined ontology. We then use Scarecrow to collect over 41k error spans in human-written and machine-generated paragraphs of English language news text. We isolate factors for detailed analysis, including parameter count, training data, and various decoding-time configurations. Our approach successfully quantifies measurable gaps between human authored text and generations from models of several sizes, including fourteen configurations of GPT-3. In addition, our analysis unveils new insights, with detailed rationales provided by laypeople, e.g., that the commonsense capabilities have been improving with larger models while math capabilities have not, and that the choices of simple decoding hyperparameters can make remarkable differences on the perceived quality of machine text. We release our training material, annotation toolkit and dataset at https://yao-dou.github.io/scarecrow/. △ Less

Submitted 7 March, 2022; v1 submitted 2 July, 2021; originally announced July 2021.

Comments: The project webpage is at https://yao-dou.github.io/scarecrow/

Gravitational Caustics in an Atom Laser

Authors: Maren E. Mossman, Thomas M. Bersano, Michael McNeil Forbes, Peter Engels

Abstract: Typically discussed in the context of optics, caustics are envelopes of classical trajectories (rays) where the density of states diverges, resulting in pronounced observable features such as bright points, curves, and extended networks of patterns. Here, we generate caustics in the matter waves of an atom laser, providing a striking experimental example of catastrophe theory applied to atom optic… ▽ More Typically discussed in the context of optics, caustics are envelopes of classical trajectories (rays) where the density of states diverges, resulting in pronounced observable features such as bright points, curves, and extended networks of patterns. Here, we generate caustics in the matter waves of an atom laser, providing a striking experimental example of catastrophe theory applied to atom optics in an accelerated (gravitational) reference frame. We showcase caustics formed by individual attractive and repulsive potentials, and present an example of a network generated by multiple potentials. Exploiting internal atomic states, we demonstrate fluid-flow tracing as another tool of this flexible experimental platform. The effective gravity experienced by the atoms can be tuned with magnetic gradients, forming caustics analogous to those produced by gravitational lensing. From a more applied point of view, atom optics affords perspectives for metrology, atom interferometry, and nanofabrication. Caustics in this context may lead to quantum innovations as they are an inherently robust way of manipulating matter waves. △ Less

Submitted 8 June, 2023; v1 submitted 27 April, 2021; originally announced April 2021.

Comments: 10 pages, 6 figures. Updated to reflect published version

Journal ref: Nature Comm. 12, 7226 (2021)

CLIPScore: A Reference-free Evaluation Metric for Image Captioning

Authors: Jack Hessel, Ari Holtzman, Maxwell Forbes, Ronan Le Bras, Ye** Choi

Abstract: Image captioning has conventionally relied on reference-based automatic evaluations, where machine captions are compared against captions written by humans. This is in contrast to the reference-free manner in which humans assess caption quality. In this paper, we report the surprising empirical finding that CLIP (Radford et al., 2021), a cross-modal model pretrained on 400M image+caption pairs f… ▽ More Image captioning has conventionally relied on reference-based automatic evaluations, where machine captions are compared against captions written by humans. This is in contrast to the reference-free manner in which humans assess caption quality. In this paper, we report the surprising empirical finding that CLIP (Radford et al., 2021), a cross-modal model pretrained on 400M image+caption pairs from the web, can be used for robust automatic evaluation of image captioning without the need for references. Experiments spanning several corpora demonstrate that our new reference-free metric, CLIPScore, achieves the highest correlation with human judgements, outperforming existing reference-based metrics like CIDEr and SPICE. Information gain experiments demonstrate that CLIPScore, with its tight focus on image-text compatibility, is complementary to existing reference-based metrics that emphasize text-text similarities. Thus, we also present a reference-augmented version, RefCLIPScore, which achieves even higher correlation. Beyond literal description tasks, several case studies reveal domains where CLIPScore performs well (clip-art images, alt-text rating), but also where it is relatively weaker in comparison to reference-based metrics, e.g., news captions that require richer contextual knowledge. △ Less

Submitted 23 March, 2022; v1 submitted 18 April, 2021; originally announced April 2021.

Journal ref: EMNLP 2021

Almost Surely Stable Deep Dynamics

Authors: Nathan P. Lawrence, Philip D. Loewen, Michael G. Forbes, Johan U. Backström, R. Bhushan Gopaluni

Abstract: We introduce a method for learning provably stable deep neural network based dynamic models from observed data. Specifically, we consider discrete-time stochastic dynamic models, as they are of particular interest in practical applications such as estimation and control. However, these aspects exacerbate the challenge of guaranteeing stability. Our method works by embedding a Lyapunov neural netwo… ▽ More We introduce a method for learning provably stable deep neural network based dynamic models from observed data. Specifically, we consider discrete-time stochastic dynamic models, as they are of particular interest in practical applications such as estimation and control. However, these aspects exacerbate the challenge of guaranteeing stability. Our method works by embedding a Lyapunov neural network into the dynamic model, thereby inherently satisfying the stability criterion. To this end, we propose two approaches and apply them in both the deterministic and stochastic settings: one exploits convexity of the Lyapunov function, while the other enforces stability through an implicit output layer. We demonstrate the utility of each approach through numerical examples. △ Less

Submitted 26 March, 2021; originally announced March 2021.

Comments: NeurIPS 2020; Spotlight Paper

Journal ref: Advances in Neural Information Processing Systems, volume 33, pages 18942--18953, 2020

A Meta-Reinforcement Learning Approach to Process Control

Authors: Daniel G. McClement, Nathan P. Lawrence, Philip D. Loewen, Michael G. Forbes, Johan U. Backström, R. Bhushan Gopaluni

Abstract: Meta-learning is a branch of machine learning which aims to quickly adapt models, such as neural networks, to perform new tasks by learning an underlying structure across related tasks. In essence, models are being trained to learn new tasks effectively rather than master a single task. Meta-learning is appealing for process control applications because the perturbations to a process required to t… ▽ More Meta-learning is a branch of machine learning which aims to quickly adapt models, such as neural networks, to perform new tasks by learning an underlying structure across related tasks. In essence, models are being trained to learn new tasks effectively rather than master a single task. Meta-learning is appealing for process control applications because the perturbations to a process required to train an AI controller can be costly and unsafe. Additionally, the dynamics and control objectives are similar across many different processes, so it is feasible to create a generalizable controller through meta-learning capable of quickly adapting to different systems. In this work, we construct a deep reinforcement learning (DRL) based controller and meta-train the controller using a latent context variable through a separate embedding neural network. We test our meta-algorithm on its ability to adapt to new process dynamics as well as different control objectives on the same process. In both cases, our meta-learning algorithm adapts very quickly to new tasks, outperforming a regular DRL controller trained from scratch. Meta-learning appears to be a promising approach for constructing more intelligent and sample-efficient controllers. △ Less

Submitted 25 March, 2021; originally announced March 2021.

Comments: ADCHEM 2021; Keynote Paper

MultiTalk: A Highly-Branching Dialog Testbed for Diverse Conversations

Authors: Yao Dou, Maxwell Forbes, Ari Holtzman, Ye** Choi

Abstract: We study conversational dialog in which there are many possible responses to a given history. We present the MultiTalk Dataset, a corpus of over 320,000 sentences of written conversational dialog that balances a high branching factor (10) with several conversation turns (6) through selective branch continuation. We make multiple contributions to study dialog generation in the highly branching sett… ▽ More We study conversational dialog in which there are many possible responses to a given history. We present the MultiTalk Dataset, a corpus of over 320,000 sentences of written conversational dialog that balances a high branching factor (10) with several conversation turns (6) through selective branch continuation. We make multiple contributions to study dialog generation in the highly branching setting. In order to evaluate a diverse set of generations, we propose a simple scoring algorithm, based on bipartite graph matching, to optimally incorporate a set of diverse references. We study multiple language generation tasks at different levels of predictive conversation depth, using textual attributes induced automatically from pretrained classifiers. Our culminating task is a challenging theory of mind problem, a controllable generation task which requires reasoning about the expected reaction of the listener. △ Less

Submitted 1 February, 2021; originally announced February 2021.

Comments: 7 pages, AAAI-21

Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequences

Authors: Denis Emelin, Ronan Le Bras, Jena D. Hwang, Maxwell Forbes, Ye** Choi

Abstract: In social settings, much of human behavior is governed by unspoken rules of conduct. For artificial systems to be fully integrated into social environments, adherence to such norms is a central prerequisite. We investigate whether contemporary NLG models can function as behavioral priors for systems deployed in social settings by generating action hypotheses that achieve predefined goals under mor… ▽ More In social settings, much of human behavior is governed by unspoken rules of conduct. For artificial systems to be fully integrated into social environments, adherence to such norms is a central prerequisite. We investigate whether contemporary NLG models can function as behavioral priors for systems deployed in social settings by generating action hypotheses that achieve predefined goals under moral constraints. Moreover, we examine if models can anticipate likely consequences of (im)moral actions, or explain why certain actions are preferable by generating relevant norms. For this purpose, we introduce 'Moral Stories', a crowd-sourced dataset of structured, branching narratives for the study of grounded, goal-oriented social reasoning. Finally, we propose decoding strategies that effectively combine multiple expert models to significantly improve the quality of generated actions, consequences, and norms compared to strong baselines, e.g. though abductive reasoning. △ Less

Submitted 31 December, 2020; originally announced December 2020.

Comments: For the 'Moral Stories' dataset, see https://github.com/demelin/moral_stories

Edited Media Understanding: Reasoning About Implications of Manipulated Images

Authors: Jeff Da, Maxwell Forbes, Rowan Zellers, Anthony Zheng, Jena D. Hwang, Antoine Bosselut, Ye** Choi

Abstract: Multimodal disinformation, from `deepfakes' to simple edits that deceive, is an important societal problem. Yet at the same time, the vast majority of media edits are harmless -- such as a filtered vacation photo. The difference between this example, and harmful edits that spread disinformation, is one of intent. Recognizing and describing this intent is a major challenge for today's AI systems.… ▽ More Multimodal disinformation, from `deepfakes' to simple edits that deceive, is an important societal problem. Yet at the same time, the vast majority of media edits are harmless -- such as a filtered vacation photo. The difference between this example, and harmful edits that spread disinformation, is one of intent. Recognizing and describing this intent is a major challenge for today's AI systems. We present the task of Edited Media Understanding, requiring models to answer open-ended questions that capture the intent and implications of an image edit. We introduce a dataset for our task, EMU, with 48k question-answer pairs written in rich natural language. We evaluate a wide variety of vision-and-language models for our task, and introduce a new model PELICAN, which builds upon recent progress in pretrained multimodal representations. Our model obtains promising results on our dataset, with humans rating its answers as accurate 40.35% of the time. At the same time, there is still much work to be done -- humans prefer human-annotated captions 93.56% of the time -- and we provide analysis that highlights areas for further progress. △ Less

Submitted 8 December, 2020; originally announced December 2020.

Social Chemistry 101: Learning to Reason about Social and Moral Norms

Authors: Maxwell Forbes, Jena D. Hwang, Vered Shwartz, Maarten Sap, Ye** Choi

Abstract: Social norms -- the unspoken commonsense rules about acceptable social behavior -- are crucial in understanding the underlying causes and intents of people's actions in narratives. For example, underlying an action such as "wanting to call cops on my neighbors" are social norms that inform our conduct, such as "It is expected that you report crimes." We present Social Chemistry, a new conceptual… ▽ More Social norms -- the unspoken commonsense rules about acceptable social behavior -- are crucial in understanding the underlying causes and intents of people's actions in narratives. For example, underlying an action such as "wanting to call cops on my neighbors" are social norms that inform our conduct, such as "It is expected that you report crimes." We present Social Chemistry, a new conceptual formalism to study people's everyday social norms and moral judgments over a rich spectrum of real life situations described in natural language. We introduce Social-Chem-101, a large-scale corpus that catalogs 292k rules-of-thumb such as "it is rude to run a blender at 5am" as the basic conceptual units. Each rule-of-thumb is further broken down with 12 different dimensions of people's judgments, including social judgments of good and bad, moral foundations, expected cultural pressure, and assumed legality, which together amount to over 4.5 million annotations of categorical labels and free-text descriptions. Comprehensive empirical results based on state-of-the-art neural models demonstrate that computational modeling of social norms is a promising research direction. Our model framework, Neural Norm Transformer, learns and generalizes Social-Chem-101 to successfully reason about previously unseen situations, generating relevant (and potentially novel) attribute-aware social rules-of-thumb. △ Less

Submitted 16 August, 2021; v1 submitted 1 November, 2020; originally announced November 2020.

Comments: Published at EMNLP 2020

Rotating quantum turbulence in the unitary Fermi gas

Authors: Khalid Hossain, Konrad Kobuszewski, Michael McNeil Forbes, Piotr Magierski, Kazuyuki Sekizawa, Gabriel Wlazłowski

Abstract: Quantized vortices carry the angular momentum in rotating superfluids, and are key to the phenomenon of quantum turbulence. Advances in ultra-cold atom technology enable quantum turbulence to be studied in regimes with both experimental and theoretical control, unlike the original contexts of superfluid helium experiments. While much work has been performed with bosonic systems, detailed studies o… ▽ More Quantized vortices carry the angular momentum in rotating superfluids, and are key to the phenomenon of quantum turbulence. Advances in ultra-cold atom technology enable quantum turbulence to be studied in regimes with both experimental and theoretical control, unlike the original contexts of superfluid helium experiments. While much work has been performed with bosonic systems, detailed studies of fermionic quantum turbulence are nascent, despite wide applicability to other contexts such as rotating neutron stars. In this paper, we present the first large-scale study of quantum turbulence in rotating fermionic superfluids using an accurate orbital based time-dependent density functional theory (DFT) called the superfluid local density approximation (SLDA). We identify two different modes of turbulent decay in the dynamical equilibration of a rotating fermionic superfluid, and contrast these results with a computationally simpler orbital-free DFT, which we find can qualitatively reproduce these decay mechanisms if dissipation is explicitly included. These results demonstrate that one-body dissipation mechanisms intrinsic to fermionic superfluids play a key role differentiating fermionic from bosonic turbulence, but also suggest that simpler orbital-free theories may be corrected so that these more efficient techniques can be used to model extended physical systems such as neutron superfluids in neutron stars. △ Less

Submitted 14 January, 2022; v1 submitted 14 October, 2020; originally announced October 2020.

Comments: 13 pages, 8 figures. Accompanying movies can be found at http://wlazlowski.fizyka.pw.edu.pl/supplement/sm-rotating-turbulence/

Report number: INT-PUB-20-040

Journal ref: Phys. Rev. A 105, 013304 (2022)

Paragraph-level Commonsense Transformers with Recurrent Memory

Authors: Saadia Gabriel, Chandra Bhagavatula, Vered Shwartz, Ronan Le Bras, Maxwell Forbes, Ye** Choi

Abstract: Human understanding of narrative texts requires making commonsense inferences beyond what is stated explicitly in the text. A recent model, COMET, can generate such implicit commonsense inferences along several dimensions such as pre- and post-conditions, motivations, and mental states of the participants. However, COMET was trained on commonsense inferences of short phrases, and is therefore disc… ▽ More Human understanding of narrative texts requires making commonsense inferences beyond what is stated explicitly in the text. A recent model, COMET, can generate such implicit commonsense inferences along several dimensions such as pre- and post-conditions, motivations, and mental states of the participants. However, COMET was trained on commonsense inferences of short phrases, and is therefore discourse-agnostic. When presented with each sentence of a multi-sentence narrative, it might generate inferences that are inconsistent with the rest of the narrative. We present the task of discourse-aware commonsense inference. Given a sentence within a narrative, the goal is to generate commonsense inferences along predefined dimensions, while maintaining coherence with the rest of the narrative. Such large-scale paragraph-level annotation is hard to get and costly, so we use available sentence-level annotations to efficiently and automatically construct a distantly supervised corpus. Using this corpus, we train PARA-COMET, a discourse-aware model that incorporates paragraph-level information to generate coherent commonsense inferences from narratives. PARA-COMET captures both semantic knowledge pertaining to prior world knowledge, and episodic knowledge involving how current events relate to prior and future events in a narrative. Our results show that PARA-COMET outperforms the sentence-level baselines, particularly in generating inferences that are both coherent and novel. △ Less

Submitted 2 February, 2021; v1 submitted 4 October, 2020; originally announced October 2020.

Comments: AAAI 2021

Optimal PID and Antiwindup Control Design as a Reinforcement Learning Problem

Authors: Nathan P. Lawrence, Gregory E. Stewart, Philip D. Loewen, Michael G. Forbes, Johan U. Backstrom, R. Bhushan Gopaluni

Abstract: Deep reinforcement learning (DRL) has seen several successful applications to process control. Common methods rely on a deep neural network structure to model the controller or process. With increasingly complicated control structures, the closed-loop stability of such methods becomes less clear. In this work, we focus on the interpretability of DRL control methods. In particular, we view linear f… ▽ More Deep reinforcement learning (DRL) has seen several successful applications to process control. Common methods rely on a deep neural network structure to model the controller or process. With increasingly complicated control structures, the closed-loop stability of such methods becomes less clear. In this work, we focus on the interpretability of DRL control methods. In particular, we view linear fixed-structure controllers as shallow neural networks embedded in the actor-critic framework. PID controllers guide our development due to their simplicity and acceptance in industrial practice. We then consider input saturation, leading to a simple nonlinear control structure. In order to effectively operate within the actuator limits we then incorporate a tuning parameter for anti-windup compensation. Finally, the simplicity of the controller allows for straightforward initialization. This makes our method inherently stabilizing, both during and after training, and amenable to known operational PID gains. △ Less

Submitted 9 May, 2020; originally announced May 2020.

Comments: IFAC World Congress 2020

Reinforcement Learning based Design of Linear Fixed Structure Controllers

Authors: Nathan P. Lawrence, Gregory E. Stewart, Philip D. Loewen, Michael G. Forbes, Johan U. Backstrom, R. Bhushan Gopaluni

Abstract: Reinforcement learning has been successfully applied to the problem of tuning PID controllers in several applications. The existing methods often utilize function approximation, such as neural networks, to update the controller parameters at each time-step of the underlying process. In this work, we present a simple finite-difference approach, based on random search, to tuning linear fixed-structu… ▽ More Reinforcement learning has been successfully applied to the problem of tuning PID controllers in several applications. The existing methods often utilize function approximation, such as neural networks, to update the controller parameters at each time-step of the underlying process. In this work, we present a simple finite-difference approach, based on random search, to tuning linear fixed-structure controllers. For clarity and simplicity, we focus on PID controllers. Our algorithm operates on the entire closed-loop step response of the system and iteratively improves the PID gains towards a desired closed-loop response. This allows for embedding stability requirements into the reward function without any modeling procedures. △ Less

Submitted 9 May, 2020; originally announced May 2020.

Comments: IFAC World Congress 2020

Shock Waves in a Superfluid with Higher-Order Dispersion

Authors: Maren E. Mossman, Edward S. Delikatny, Michael McNeil Forbes, Peter Engels

Abstract: Higher-order dispersion can lead to intriguing dynamics that are becoming a focus of modern hydrodynamics research. Such systems occur naturally, for example in shallow water waves and nonlinear optics, for which several types of novel dispersive shocks structures have been identified. Here we introduce ultracold atoms as a tunable quantum simulations platform for higher-order systems. Degenerate… ▽ More Higher-order dispersion can lead to intriguing dynamics that are becoming a focus of modern hydrodynamics research. Such systems occur naturally, for example in shallow water waves and nonlinear optics, for which several types of novel dispersive shocks structures have been identified. Here we introduce ultracold atoms as a tunable quantum simulations platform for higher-order systems. Degenerate quantum gases are well controlled model systems for the experimental study of dispersive hydrodynamics in superfluids and have been used to investigate phenomena such as vortices, solitons, dispersive shock waves and quantum turbulence. With the advent of Raman-induced spin-orbit coupling, the dispersion of a dilute gas Bose-Einstein condensate can be modified in a flexible way, allowing for detailed investigations of higher-order dispersion dynamics. Here we present a combined experimental and theoretical study of shock structures generated in such a system. The breaking of Galilean invariance by the spin-orbit coupling allows two different types of shock structures to emerge simultaneously in a single system. Numerical simulations suggest that the behavior of these shock structures is affected by interactions with vortices in a manner reminiscent of emerging viscous hydrodynamics due to an underlying quantum turbulence in the system. This result suggests that spin-orbit coupling can be used as a powerful means to tun the effective viscosity in cold-atom experiments serving as quantum simulators of turbulent hydrodynamics, with applications from condensed matter and optics to quantum simulations of neutron stars. △ Less

Submitted 2 April, 2020; originally announced April 2020.

Comments: 10 pages, 6 figures

Report number: INT-PUB-20-013

Journal ref: Phys. Rev. A 102, 053310 (2020)

Neural Naturalist: Generating Fine-Grained Image Comparisons

Authors: Maxwell Forbes, Christine Kaeser-Chen, Piyush Sharma, Serge Belongie

Abstract: We introduce the new Birds-to-Words dataset of 41k sentences describing fine-grained differences between photographs of birds. The language collected is highly detailed, while remaining understandable to the everyday observer (e.g., "heart-shaped face," "squat body"). Paragraph-length descriptions naturally adapt to varying levels of taxonomic and visual distance---drawn from a novel stratified sa… ▽ More We introduce the new Birds-to-Words dataset of 41k sentences describing fine-grained differences between photographs of birds. The language collected is highly detailed, while remaining understandable to the everyday observer (e.g., "heart-shaped face," "squat body"). Paragraph-length descriptions naturally adapt to varying levels of taxonomic and visual distance---drawn from a novel stratified sampling approach---with the appropriate level of detail. We propose a new model called Neural Naturalist that uses a joint image encoding and comparative module to generate comparative language, and evaluate the results with humans who must use the descriptions to distinguish real images. Our results indicate promising potential for neural models to explain differences in visual embedding space using natural language, as well as a concrete path for machine learning to aid citizen scientists in their effort to preserve biodiversity. △ Less

Submitted 13 November, 2019; v1 submitted 9 September, 2019; originally announced September 2019.

Comments: Published at EMNLP 2019

Do Neural Language Representations Learn Physical Commonsense?

Authors: Maxwell Forbes, Ari Holtzman, Ye** Choi

Abstract: Humans understand language based on the rich background knowledge about how the physical world works, which in turn allows us to reason about the physical world through language. In addition to the properties of objects (e.g., boats require fuel) and their affordances, i.e., the actions that are applicable to them (e.g., boats can be driven), we can also reason about if-then inferences between wha… ▽ More Humans understand language based on the rich background knowledge about how the physical world works, which in turn allows us to reason about the physical world through language. In addition to the properties of objects (e.g., boats require fuel) and their affordances, i.e., the actions that are applicable to them (e.g., boats can be driven), we can also reason about if-then inferences between what properties of objects imply the kind of actions that are applicable to them (e.g., that if we can drive something then it likely requires fuel). In this paper, we investigate the extent to which state-of-the-art neural language representations, trained on a vast amount of natural language text, demonstrate physical commonsense reasoning. While recent advancements of neural language models have demonstrated strong performance on various types of natural language inference tasks, our study based on a dataset of over 200k newly collected annotations suggests that neural language representations still only learn associations that are explicitly written down. △ Less

Submitted 7 August, 2019; originally announced August 2019.

Comments: Published in The Proceedings of the 41st Annual Conference of the Cognitive Science Society (CogSci 2019)

The Curious Case of Neural Text Degeneration

Authors: Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, Ye** Choi

Abstract: Despite considerable advancements with deep neural language models, the enigma of neural text degeneration persists when these models are tested as text generators. The counter-intuitive empirical observation is that even though the use of likelihood as training objective leads to high quality models for a broad range of language understanding tasks, using likelihood as a decoding objective leads… ▽ More Despite considerable advancements with deep neural language models, the enigma of neural text degeneration persists when these models are tested as text generators. The counter-intuitive empirical observation is that even though the use of likelihood as training objective leads to high quality models for a broad range of language understanding tasks, using likelihood as a decoding objective leads to text that is bland and strangely repetitive. In this paper, we reveal surprising distributional differences between human text and machine text. In addition, we find that decoding strategies alone can dramatically effect the quality of machine text, even when generated from exactly the same neural language model. Our findings motivate Nucleus Sampling, a simple but effective method to draw the best out of neural generation. By sampling text from the dynamic nucleus of the probability distribution, which allows for diversity while effectively truncating the less reliable tail of the distribution, the resulting text better demonstrates the quality of human text, yielding enhanced diversity without sacrificing fluency and coherence. △ Less

Submitted 14 February, 2020; v1 submitted 22 April, 2019; originally announced April 2019.

Comments: Published in ICLR 2020

Constraining the neutron-matter equation of state with gravitational waves

Authors: Michael McNeil Forbes, Sukanta Bose, Sanjay Reddy, Dake Zhou, Arunava Mukherjee, Soumi De

Abstract: We show how observations of gravitational waves from binary neutron star (BNS) mergers over the next few years can be combined with insights from nuclear physics to obtain useful constraints on the equation of state (EoS) of dense matter, in particular, constraining the neutron-matter EoS to within 20% between one and two times the nuclear saturation density $n_0\approx 0.16\ {\text{fm}^{-3}}$. Us… ▽ More We show how observations of gravitational waves from binary neutron star (BNS) mergers over the next few years can be combined with insights from nuclear physics to obtain useful constraints on the equation of state (EoS) of dense matter, in particular, constraining the neutron-matter EoS to within 20% between one and two times the nuclear saturation density $n_0\approx 0.16\ {\text{fm}^{-3}}$. Using Fisher information methods, we combine observational constraints from simulated BNS merger events drawn from various population models with independent measurements of the neutron star radii expected from x-ray astronomy (the Neutron Star Interior Composition Explorer (NICER) observations in particular) to directly constrain nuclear physics parameters. To parameterize the nuclear EoS, we use a different approach, expanding from pure nuclear matter rather than from symmetric nuclear matter to make use of recent quantum Monte Carlo (QMC) calculations. This method eschews the need to invoke the so-called parabolic approximation to extrapolate from symmetric nuclear matter, allowing us to directly constrain the neutron-matter EoS. Using a principal component analysis, we identify the combination of parameters most tightly constrained by observational data. We discuss sensitivity to various effects such as different component masses through population-model sensitivity, phase transitions in the core EoS, and large deviations from the central parameter values. △ Less

Submitted 8 April, 2019; originally announced April 2019.

Comments: 13 pages, 9 figures + supplement 11 pages

Report number: LIGO-P1900097, INT-PUB-19-009

Journal ref: Phys. Rev. D 100, 083010 (2019)

Pseudorandom Generators for Read-Once Branching Programs, in any Order

Authors: Michael A. Forbes, Zander Kelley

Abstract: A central question in derandomization is whether randomized logspace (RL) equals deterministic logspace (L). To show that RL=L, it suffices to construct explicit pseudorandom generators (PRGs) that fool polynomial-size read-once (oblivious) branching programs (roBPs). Starting with the work of Nisan, pseudorandom generators with seed-length $O(\log^2 n)$ were constructed. Unfortunately, improving… ▽ More A central question in derandomization is whether randomized logspace (RL) equals deterministic logspace (L). To show that RL=L, it suffices to construct explicit pseudorandom generators (PRGs) that fool polynomial-size read-once (oblivious) branching programs (roBPs). Starting with the work of Nisan, pseudorandom generators with seed-length $O(\log^2 n)$ were constructed. Unfortunately, improving on this seed-length in general has proven challenging and seems to require new ideas. A recent line of inquiry has suggested focusing on a particular limitation of the existing PRGs, which is that they only fool roBPs when the variables are read in a particular known order, such as $x_1<\cdots<x_n$. In comparison, existentially one can obtain logarithmic seed-length for fooling the set of polynomial-size roBPs that read the variables under any fixed unknown permutation $x_{π(1)}<\cdots<x_{π(n)}$. While recent works have established novel PRGs in this setting for subclasses of roBPs, there were no known $n^{o(1)}$ seed-length explicit PRGs for general polynomial-size roBPs in this setting. In this work, we follow the "bounded independence plus noise" paradigm of Haramaty, Lee and Viola, and give an improved analysis in the general roBP unknown-order setting. With this analysis we obtain an explicit PRG with seed-length $O(\log^3 n)$ for polynomial-size roBPs reading their bits in an unknown order. Plugging in a recent Fourier tail bound of Chattopadhyay, Hatami, Reingold, and Tal, we can obtain a $\widetilde{O}(\log^2 n)$ seed-length when the roBP is of constant width. △ Less

Submitted 19 August, 2018; originally announced August 2018.

Balancing Shared Autonomy with Human-Robot Communication

Authors: Rosario Scalise, Yonatan Bisk, Maxwell Forbes, Daqing Yi, Ye** Choi, Siddhartha Srinivasa

Abstract: Robotic agents that share autonomy with a human should leverage human domain knowledge and account for their preferences when completing a task. This extra knowledge can dramatically improve plan efficiency and user-satisfaction, but these gains are lost if communicating with a robot is taxing and unnatural. In this paper, we show how viewing humanrobot language through the lens of shared autonomy… ▽ More Robotic agents that share autonomy with a human should leverage human domain knowledge and account for their preferences when completing a task. This extra knowledge can dramatically improve plan efficiency and user-satisfaction, but these gains are lost if communicating with a robot is taxing and unnatural. In this paper, we show how viewing humanrobot language through the lens of shared autonomy explains the efficiency versus cognitive load trade-offs humans make when deciding how cooperative and explicit to make their instructions. △ Less

Submitted 20 May, 2018; originally announced May 2018.

Learning to Write with Cooperative Discriminators

Authors: Ari Holtzman, Jan Buys, Maxwell Forbes, Antoine Bosselut, David Golub, Ye** Choi

Abstract: Recurrent Neural Networks (RNNs) are powerful autoregressive sequence models, but when used to generate natural language their output tends to be overly generic, repetitive, and self-contradictory. We postulate that the objective function optimized by RNN language models, which amounts to the overall perplexity of a text, is not expressive enough to capture the notion of communicative goals descri… ▽ More Recurrent Neural Networks (RNNs) are powerful autoregressive sequence models, but when used to generate natural language their output tends to be overly generic, repetitive, and self-contradictory. We postulate that the objective function optimized by RNN language models, which amounts to the overall perplexity of a text, is not expressive enough to capture the notion of communicative goals described by linguistic principles such as Grice's Maxims. We propose learning a mixture of multiple discriminative models that can be used to complement the RNN generator and guide the decoding process. Human evaluation demonstrates that text generated by our system is preferred over that of baselines by a large margin and significantly enhances the overall coherence, style, and information content of the generated text. △ Less

Submitted 15 May, 2018; originally announced May 2018.

Comments: In Proceedings of ACL 2018

Spatial Isolation Implies Zero Knowledge Even in a Quantum World

Authors: Alessandro Chiesa, Michael A. Forbes, Tom Gur, Nicholas Spooner

Abstract: Zero knowledge plays a central role in cryptography and complexity. The seminal work of Ben-Or et al. (STOC 1988) shows that zero knowledge can be achieved unconditionally for any language in NEXP, as long as one is willing to make a suitable physical assumption: if the provers are spatially isolated, then they can be assumed to be playing independent strategies. Quantum mechanics, however, tells… ▽ More Zero knowledge plays a central role in cryptography and complexity. The seminal work of Ben-Or et al. (STOC 1988) shows that zero knowledge can be achieved unconditionally for any language in NEXP, as long as one is willing to make a suitable physical assumption: if the provers are spatially isolated, then they can be assumed to be playing independent strategies. Quantum mechanics, however, tells us that this assumption is unrealistic, because spatially-isolated provers could share a quantum entangled state and realize a non-local correlated strategy. The MIP* model captures this setting. In this work we study the following question: does spatial isolation still suffice to unconditionally achieve zero knowledge even in the presence of quantum entanglement? We answer this question in the affirmative: we prove that every language in NEXP has a 2-prover zero knowledge interactive proof that is sound against entangled provers; that is, NEXP \subseteq ZK-MIP*. Our proof consists of constructing a zero knowledge interactive PCP with a strong algebraic structure, and then lifting it to the MIP* model. This lifting relies on a new framework that builds on recent advances in low-degree testing against entangled strategies, and clearly separates classical and quantum tools. Our main technical contribution consists of develo** new algebraic techniques for obtaining unconditional zero knowledge; this includes a zero knowledge variant of the celebrated sumcheck protocol, a key building block in many probabilistic proof systems. A core component of our sumcheck protocol is a new algebraic commitment scheme, whose analysis relies on algebraic complexity theory. △ Less

Submitted 5 March, 2018; originally announced March 2018.

Comments: 55 pages. arXiv admin note: text overlap with arXiv:1704.02086

A PSPACE Construction of a Hitting Set for the Closure of Small Algebraic Circuits

Authors: Michael A. Forbes, Amir Shpilka

Abstract: In this paper we study the complexity of constructing a hitting set for the closure of VP, the class of polynomials that can be infinitesimally approximated by polynomials that are computed by polynomial sized algebraic circuits, over the real or complex numbers. Specifically, we show that there is a PSPACE algorithm that given n,s,r in unary outputs a set of n-tuples over the rationals of size po… ▽ More In this paper we study the complexity of constructing a hitting set for the closure of VP, the class of polynomials that can be infinitesimally approximated by polynomials that are computed by polynomial sized algebraic circuits, over the real or complex numbers. Specifically, we show that there is a PSPACE algorithm that given n,s,r in unary outputs a set of n-tuples over the rationals of size poly(n,s,r), with poly(n,s,r) bit complexity, that hits all n-variate polynomials of degree-r that are the limit of size-s algebraic circuits. Previously it was known that a random set of this size is a hitting set, but a construction that is certified to work was only known in EXPSPACE (or EXPH assuming the generalized Riemann hypothesis). As a corollary we get that a host of other algebraic problems such as Noether Normalization Lemma, can also be solved in PSPACE deterministically, where earlier only randomized algorithms and EXPSPACE algorithms (or EXPH assuming the generalized Riemann hypothesis) were known. The proof relies on the new notion of a robust hitting set which is a set of inputs such that any nonzero polynomial that can be computed by a polynomial size algebraic circuit, evaluates to a not too small value on at least one element of the set. Proving the existence of such a robust hitting set is the main technical difficulty in the proof. Our proof uses anti-concentration results for polynomials, basic tools from algebraic geometry and the existential theory of the reals. △ Less

Submitted 28 December, 2017; originally announced December 2017.

A Minimal Nuclear Energy Density Functional

Authors: Aurel Bulgac, Michael McNeil Forbes, Shi **, Rodrigo Navarro Perez, Nicolas Schunck

Abstract: We present a minimal nuclear energy density functional (NEDF) called "SeaLL1" that has the smallest number of possible phenomenological parameters to date. SeaLL1 is defined by 7 significant phenomenological parameters, each related to a specific nuclear property. It describes the nuclear masses of even-even nuclei with a mean energy error of 0.97 MeV and a standard deviation 1.46 MeV, two-neutron… ▽ More We present a minimal nuclear energy density functional (NEDF) called "SeaLL1" that has the smallest number of possible phenomenological parameters to date. SeaLL1 is defined by 7 significant phenomenological parameters, each related to a specific nuclear property. It describes the nuclear masses of even-even nuclei with a mean energy error of 0.97 MeV and a standard deviation 1.46 MeV, two-neutron and two-proton separation energies with r.m.s. errors of 0.69 MeV and 0.59 MeV respectively, and the charge radii of 345 even-even nuclei with a mean error $ε_r=$0.022 fm and a standard deviation $σ_r=$0.025 fm. SeaLL1 incorporates constraints on the EoS of pure neutron matter from quantum Monte Carlo calculations with chiral effective field theory two-body (NN) interactions at N3LO level and three-body (NNN) interactions at the N2LO level. Two of the seven parameters are related to the saturation density and the energy per particle of the homogeneous symmetric nuclear matter, one is related to the nuclear surface tension, two are related to the symmetry energy and its density dependence, one is related to the strength of the spin-orbit interaction, and one is the coupling constant of the pairing interaction. We identify additional phenomenological parameters that have little effect on ground-state properties, but can be used to fine-tune features such as the Thomas-Reiche-Kuhn sum rule, the excitation energy of the giant dipole and Gamow-Teller resonances, the static dipole electric polarizability, and the neutron skin thickness. △ Less

Submitted 10 May, 2018; v1 submitted 27 August, 2017; originally announced August 2017.

Comments: Updated to match published version. This article supersedes arXiv:1506.09195. Fit data provided in source files *.txt. (35 pages, 23 figures.)

Report number: NT@UW-17-12

Journal ref: Phys. Rev. C 97, 044313 (2018)

Verb Physics: Relative Physical Knowledge of Actions and Objects

Authors: Maxwell Forbes, Ye** Choi

Abstract: Learning commonsense knowledge from natural language text is nontrivial due to reporting bias: people rarely state the obvious, e.g., "My house is bigger than me." However, while rarely stated explicitly, this trivial everyday knowledge does influence the way people talk about the world, which provides indirect clues to reason about the world. For example, a statement like, "Tyler entered his hous… ▽ More Learning commonsense knowledge from natural language text is nontrivial due to reporting bias: people rarely state the obvious, e.g., "My house is bigger than me." However, while rarely stated explicitly, this trivial everyday knowledge does influence the way people talk about the world, which provides indirect clues to reason about the world. For example, a statement like, "Tyler entered his house" implies that his house is bigger than Tyler. In this paper, we present an approach to infer relative physical knowledge of actions and objects along five dimensions (e.g., size, weight, and strength) from unstructured natural language text. We frame knowledge acquisition as joint inference over two closely related problems: learning (1) relative physical knowledge of object pairs and (2) physical implications of actions when applied to those object pairs. Empirical results demonstrate that it is possible to extract knowledge of actions and objects from language and that joint inference over different types of knowledge improves performance. △ Less

Submitted 12 July, 2017; v1 submitted 12 June, 2017; originally announced June 2017.

Comments: 11 pages, published in Proceedings of ACL 2017

A Zero Knowledge Sumcheck and its Applications

Authors: Alessandro Chiesa, Michael A. Forbes, Nicholas Spooner

Abstract: Many seminal results in Interactive Proofs (IPs) use algebraic techniques based on low-degree polynomials, the study of which is pervasive in theoretical computer science. Unfortunately, known methods for endowing such proofs with zero knowledge guarantees do not retain this rich algebraic structure. In this work, we develop algebraic techniques for obtaining zero knowledge variants of proof pro… ▽ More Many seminal results in Interactive Proofs (IPs) use algebraic techniques based on low-degree polynomials, the study of which is pervasive in theoretical computer science. Unfortunately, known methods for endowing such proofs with zero knowledge guarantees do not retain this rich algebraic structure. In this work, we develop algebraic techniques for obtaining zero knowledge variants of proof protocols in a way that leverages and preserves their algebraic structure. Our constructions achieve unconditional (perfect) zero knowledge in the Interactive Probabilistically Checkable Proof (IPCP) model of Kalai and Raz [KR08] (the prover first sends a PCP oracle, then the prover and verifier engage in an Interactive Proof in which the verifier may query the PCP). Our main result is a zero knowledge variant of the sumcheck protocol [LFKN92] in the IPCP model. The sumcheck protocol is a key building block in many IPs, including the protocol for polynomial-space computation due to Shamir [Sha92], and the protocol for parallel computation due to Goldwasser, Kalai, and Rothblum [GKR15]. A core component of our result is an algebraic commitment scheme, whose hiding property is guaranteed by algebraic query complexity lower bounds [AW09,JKRS09]. This commitment scheme can then be used to considerably strengthen our previous work [BCFGRS16] that gives a sumcheck protocol with much weaker zero knowledge guarantees, itself using algebraic techniques based on algorithms for polynomial identity testing [RS05,BW04]. We demonstrate the applicability of our techniques by deriving zero knowledge variants of well-known protocols based on algebraic techniques, including the protocols of Shamir and of Goldwasser, Kalai, and Rothblum, as well as the protocol of Babai, Fortnow, and Lund [BFL91]. △ Less

Submitted 6 April, 2017; originally announced April 2017.

Disaggregated Benders decomposition and lazy constraints for solving the budget-constrained dynamic uncapacitated facility location and network design problem

Authors: Robin H Pearce, Michael Forbes

Abstract: We present an approach for solving to optimality the budget-constrained Dynamic Uncapacitated Facility Location and Network Design problem (DUFLNDP). This is a problem where a network must be constructed or expanded and facilities placed in the network, subject to a budget, in order to satisfy a number of demands. With the demands satisfied, the objective is to minimise the running cost of the net… ▽ More We present an approach for solving to optimality the budget-constrained Dynamic Uncapacitated Facility Location and Network Design problem (DUFLNDP). This is a problem where a network must be constructed or expanded and facilities placed in the network, subject to a budget, in order to satisfy a number of demands. With the demands satisfied, the objective is to minimise the running cost of the network and the cost of moving demands to facilities. The problem can be disaggregated over two different sets simultaneously, leading to many smaller models which can be solved more easily. Using disaggregated Benders decomposition and lazy constraints, we solve many instances to optimality that have not previously been solved. We use an analytic procedure to generate Benders optimality cuts which are provably Pareto-optimal. △ Less

Submitted 19 March, 2017; originally announced March 2017.

Comments: 31 pages, 1 figure, 7 tables

MSC Class: 90B10; 90B80

Small hitting-sets for tiny arithmetic circuits or: How to turn bad designs into good

Authors: Manindra Agrawal, Michael Forbes, Sumanta Ghosh, Nitin Saxena

Abstract: We show that if we can design poly($s$)-time hitting-sets for $Σ\wedge^aΣΠ^{O(\log s)}$ circuits of size $s$, where $a=ω(1)$ is arbitrarily small and the number of variables, or arity $n$, is $O(\log s)$, then we can derandomize blackbox PIT for general circuits in quasipolynomial time. This also establishes that either E$\not\subseteq$\#P/poly or that VP$\ne$VNP. In fact, we show that one only ne… ▽ More We show that if we can design poly($s$)-time hitting-sets for $Σ\wedge^aΣΠ^{O(\log s)}$ circuits of size $s$, where $a=ω(1)$ is arbitrarily small and the number of variables, or arity $n$, is $O(\log s)$, then we can derandomize blackbox PIT for general circuits in quasipolynomial time. This also establishes that either E$\not\subseteq$\#P/poly or that VP$\ne$VNP. In fact, we show that one only needs a poly($s$)-time hitting-set against individual-degree $a'=ω(1)$ polynomials that are computable by a size-$s$ arity-$(\log s)$ $ΣΠΣ$ circuit (note: $Π$ fanin may be $s$). Alternatively, we claim that, to understand VP one only needs to find hitting-sets, for depth-$3$, that have a small parameterized complexity. Another tiny family of interest is when we restrict the arity $n=ω(1)$ to be arbitrarily small. We show that if we can design poly($s,μ(n)$)-time hitting-sets for size-$s$ arity-$n$ $ΣΠΣ\wedge$ circuits (resp.~$Σ\wedge^aΣΠ$), where function $μ$ is arbitrary, then we can solve PIT for VP in quasipoly-time, and prove the corresponding lower bounds. Our methods are strong enough to prove a surprising {\em arity reduction} for PIT-- to solve the general problem completely it suffices to find a blackbox PIT with time-complexity $sd2^{O(n)}$. We give several examples of ($\log s$)-variate circuits where a new measure (called cone-size) helps in devising poly-time hitting-sets, but the same question for their $s$-variate versions is open till date: For eg., diagonal depth-$3$ circuits, and in general, models that have a {\em small} partial derivative space. We also introduce a new concept, called cone-closed basis isolation, and provide example models where it occurs, or can be achieved by a small shift. △ Less

Submitted 23 February, 2017; originally announced February 2017.

Comments: 25 pages, No figures

ACM Class: F.1.1; I.1.2; F.1.3

Succinct Hitting Sets and Barriers to Proving Algebraic Circuits Lower Bounds

Authors: Michael A. Forbes, Amir Shpilka, Ben Lee Volk

Abstract: We formalize a framework of algebraically natural lower bounds for algebraic circuits. Just as with the natural proofs notion of Razborov and Rudich for boolean circuit lower bounds, our notion of algebraically natural lower bounds captures nearly all lower bound techniques known. However, unlike the boolean setting, there has been no concrete evidence demonstrating that this is a barrier to obtai… ▽ More We formalize a framework of algebraically natural lower bounds for algebraic circuits. Just as with the natural proofs notion of Razborov and Rudich for boolean circuit lower bounds, our notion of algebraically natural lower bounds captures nearly all lower bound techniques known. However, unlike the boolean setting, there has been no concrete evidence demonstrating that this is a barrier to obtaining super-polynomial lower bounds for general algebraic circuits, as there is little understanding whether algebraic circuits are expressive enough to support "cryptography" secure against algebraic circuits. Following a similar result of Williams in the boolean setting, we show that the existence of an algebraic natural proofs barrier is equivalent to the existence of succinct derandomization of the polynomial identity testing problem. That is, whether the coefficient vectors of polylog(N)-degree polylog(N)-size circuits is a hitting set for the class of poly(N)-degree poly(N)-size circuits. Further, we give an explicit universal construction showing that if such a succinct hitting set exists, then our universal construction suffices. Further, we assess the existing literature constructing hitting sets for restricted classes of algebraic circuits and observe that none of them are succinct as given. Yet, we show how to modify some of these constructions to obtain succinct hitting sets. This constitutes the first evidence supporting the existence of an algebraic natural proofs barrier. Our framework is similar to the Geometric Complexity Theory (GCT) program of Mulmuley and Sohoni, except that here we emphasize constructiveness of the proofs while the GCT program emphasizes symmetry. Nevertheless, our succinct hitting sets have relevance to the GCT program as they imply lower bounds for the complexity of the defining equations of polynomials computed by small circuits. △ Less

Submitted 22 July, 2018; v1 submitted 19 January, 2017; originally announced January 2017.

Comments: Fixed typos and other small errors; added references to follow-up work

Negative mass hydrodynamics in a Spin-Orbit--Coupled Bose-Einstein Condensate

Authors: M. A. Khamehchi, Khalid Hossain, M. E. Mossman, Yong** Zhang, Th. Busch, Michael McNeil Forbes, P. Engels

Abstract: A negative effective mass can be realized in quantum systems by engineering the dispersion relation. A powerful method is provided by spin-orbit coupling, which is currently at the center of intense research efforts. Here we measure an expanding spin-orbit coupled Bose-Einstein condensate whose dispersion features a region of negative effective mass. We observe a range of dynamical phenomena, incl… ▽ More A negative effective mass can be realized in quantum systems by engineering the dispersion relation. A powerful method is provided by spin-orbit coupling, which is currently at the center of intense research efforts. Here we measure an expanding spin-orbit coupled Bose-Einstein condensate whose dispersion features a region of negative effective mass. We observe a range of dynamical phenomena, including the breaking of parity and of Galilean covariance, dynamical instabilities, and self-trap**. The experimental findings are reproduced by a single-band Gross-Pitaevskii simulation, demonstrating that the emerging features - shockwaves, soliton trains, self-trap**, etc. - originate from a modified dispersion. Our work also sheds new light on related phenomena in optical lattices, where the underlying periodic structure often complicates their interpretation. △ Less

Submitted 19 April, 2017; v1 submitted 13 December, 2016; originally announced December 2016.

Comments: 9 pages, 6 figures: Minor updated bringing this in line with published version

Journal ref: Phys. Rev. Lett. 118, 155301 (2017)

On Probabilistic Checking in Perfect Zero Knowledge

Authors: Eli Ben-Sasson, Alessandro Chiesa, Michael A. Forbes, Ariel Gabizon, Michael Riabzev, Nicholas Spooner

Abstract: We present the first constructions of single-prover proof systems that achieve perfect zero knowledge (PZK) for languages beyond NP, under no intractability assumptions: 1. The complexity class #P has PZK proofs in the model of Interactive PCPs (IPCPs) [KR08], where the verifier first receives from the prover a PCP and then engages with the prover in an Interactive Proof (IP). 2. The complexit… ▽ More We present the first constructions of single-prover proof systems that achieve perfect zero knowledge (PZK) for languages beyond NP, under no intractability assumptions: 1. The complexity class #P has PZK proofs in the model of Interactive PCPs (IPCPs) [KR08], where the verifier first receives from the prover a PCP and then engages with the prover in an Interactive Proof (IP). 2. The complexity class NEXP has PZK proofs in the model of Interactive Oracle Proofs (IOPs) [BCS16,RRR16], where the verifier, in every round of interaction, receives a PCP from the prover. Our constructions rely on succinct simulators that enable us to "simulate beyond NP", achieving exponential savings in efficiency over [BCGV16]. These simulators crucially rely on solving a problem that lies at the intersection of coding theory, linear algebra, and computational complexity, which we call the succinct constraint detection problem, and consists of detecting dual constraints with polynomial support size for codes of exponential block length. Our two results rely on solutions to this problem for fundamental classes of linear codes: * An algorithm to detect constraints for Reed--Muller codes of exponential length. * An algorithm to detect constraints for PCPs of Proximity of Reed--Solomon codes [BS08] of exponential degree. The first algorithm exploits the Raz--Shpilka [RS05] deterministic polynomial identity testing algorithm, and shows, to our knowledge, a first connection of algebraic complexity theory with zero knowledge. Along the way, we give a perfect zero knowledge analogue of the celebrated sumcheck protocol [LFKN92], by leveraging both succinct constraint detection and low-degree testing. The second algorithm exploits the recursive structure of the PCPs of Proximity to show that small-support constraints are "locally" spanned by a small number of small-support constraints. △ Less

Submitted 12 October, 2016; originally announced October 2016.

Microscopic Calculations of Vortex-Nucleus Interaction in the Neutron Star Crust

Authors: Kazuyuki Sekizawa, Gabriel Wlazłowski, Piotr Magierski, Aurel Bulgac, Michael McNeil Forbes

Abstract: We investigate the dynamics of a quantized vortex and a nuclear impurity immersed in a neutron superfluid within a fully microscopic time-dependent three-dimensional approach. The magnitude and even the sign of the force between the quantized vortex and the nuclear impurity have been a matter of debate for over four decades. We determine that the vortex and the impurity repel at neutron densities,… ▽ More We investigate the dynamics of a quantized vortex and a nuclear impurity immersed in a neutron superfluid within a fully microscopic time-dependent three-dimensional approach. The magnitude and even the sign of the force between the quantized vortex and the nuclear impurity have been a matter of debate for over four decades. We determine that the vortex and the impurity repel at neutron densities, 0.014 fm$^{-3}$ and 0.031 fm$^{-3}$, which are relevant to the neutron star crust and the origin of glitches, while previous calculations have concluded that the force changes its sign between these two densities and predicted contradictory signs. The magnitude of the force increases with the density of neutron superfluid, while the magnitude of the pairing gap decreases in this density range. △ Less

Submitted 11 September, 2016; originally announced September 2016.

Comments: 4 pages, 2 figures, Talk given at the 14th International Symposium on "Nuclei in the Cosmos" (NIC-XIV), June 19-24, 2016, Toki Messe, Niigata, Japan

Report number: NT@UW-16-11

Journal ref: JPS Conf. Proc. 14, 010807 (2017)

Towards Quantum Turbulence in Cold Atomic Fermionic Superfluids

Authors: Aurel Bulgac, Michael McNeil Forbes, Gabriel Wlazłowski

Abstract: Fermionic superfluids provide a new realization of quantum turbulence, accessible to both experiment and theory, yet relevant to phenomena from both cold atoms to nuclear astrophysics. In particular, the strongly interacting Fermi gas realized in cold-atom experiments is closely related to dilute neutron matter in neutron star crusts. Unlike the liquid superfluids 4He (bosons) and 3He (fermions) w… ▽ More Fermionic superfluids provide a new realization of quantum turbulence, accessible to both experiment and theory, yet relevant to phenomena from both cold atoms to nuclear astrophysics. In particular, the strongly interacting Fermi gas realized in cold-atom experiments is closely related to dilute neutron matter in neutron star crusts. Unlike the liquid superfluids 4He (bosons) and 3He (fermions) where quantum turbulence has been studied in the laboratory, superfluid Fermi gases stand apart for a number of reasons. They admit a reliable theoretical description based on a DFT called the TDSLDA that describes both static and dynamic phenomena. Cold atom experiments demonstrate exquisite control over particle number, spin polarization, density, temperature, and interaction strength. Topological defects such as domain walls and quantized vortices, which lie at the heart of quantum turbulence, can be created and manipulated with time-dependent external potentials, and agree with the time-dependent theoretical techniques. While similar experimental and theoretical control exists for weakly interacting Bose gases, the unitary Fermi gas is strongly interacting. The resulting vortex line density is extremely high, and quantum turbulence may thus be realized in small systems where classical turbulence is suppressed. Fermi gases also permit the study of exotic superfluid phenomena such as a 3D LOFF supersolid, and a finite temperature pseudo-gap in the regime of classical turbulence. The dynamics associated with these phenomena has only started to be explored. Finally, superfluid mixtures have recently been realized, providing experimental access to phenomena like Andreev-Bashkin entrainment. Superfluid Fermi gases thus provide a rich forum for addressing phenomena related to quantum turbulence with applications ranging from terrestrial superfluidity to astrophysical dynamics in neutron stars. △ Less

Submitted 9 December, 2016; v1 submitted 1 September, 2016; originally announced September 2016.

Comments: 12 pages, 5 figures: Updated to correspond with published version (minor updates, 1 new figure comparing theory and experiment)

Report number: NT@UW-16-10, INT-PUB-16-026

Journal ref: J. Phys. B, 50, 014001, (2017)