-
Linking Emergent and Natural Languages via Corpus Transfer
Authors:
Shunyu Yao,
Mo Yu,
Yang Zhang,
Karthik R Narasimhan,
Joshua B. Tenenbaum,
Chuang Gan
Abstract:
The study of language emergence aims to understand how human languages are shaped by perceptual grounding and communicative intent. Computational approaches to emergent communication (EC) predominantly consider referential games in limited domains and analyze the learned protocol within the game framework. As a result, it remains unclear how the emergent languages from these settings connect to na…
▽ More
The study of language emergence aims to understand how human languages are shaped by perceptual grounding and communicative intent. Computational approaches to emergent communication (EC) predominantly consider referential games in limited domains and analyze the learned protocol within the game framework. As a result, it remains unclear how the emergent languages from these settings connect to natural languages or provide benefits in real-world language processing tasks, where statistical models trained on large text corpora dominate. In this work, we propose a novel way to establish such a link by corpus transfer, i.e. pretraining on a corpus of emergent language for downstream natural language tasks, which is in contrast to prior work that directly transfers speaker and listener parameters. Our approach showcases non-trivial transfer benefits for two different tasks -- language modeling and image captioning. For example, in a low-resource setup (modeling 2 million natural language tokens), pre-training on an emergent language corpus with just 2 million tokens reduces model perplexity by $24.6\%$ on average across ten natural languages. We also introduce a novel metric to predict the transferability of an emergent language by translating emergent messages to natural language captions grounded on the same images. We find that our translation-based metric highly correlates with the downstream performance on modeling natural languages (for instance $ρ=0.83$ on Hebrew), while topographic similarity, a popular metric in previous work, shows surprisingly low correlation ($ρ=0.003$), hinting that simple properties like attribute disentanglement from synthetic domains might not capture the full complexities of natural language. Our findings also indicate potential benefits of moving language emergence forward with natural language resources and models.
△ Less
Submitted 24 March, 2022;
originally announced March 2022.
-
Foundational Patterns for Efficient Quantum Computing
Authors:
Austin Gilliam,
Charlene Venci,
Sreraman Muralidharan,
Vitaliy Dorum,
Eric May,
Rajesh Narasimhan,
Constantin Gonciulea
Abstract:
We present a number of quantum computing patterns that build on top of fundamental algorithms, that can be applied to solving concrete, NP-hard problems. In particular, we introduce the concept of a quantum dictionary as a summation of multiple patterns and algorithms, and show how it can be applied in the context of Quadratic Unconstrained Binary Optimization (QUBO) problems. We start by presenti…
▽ More
We present a number of quantum computing patterns that build on top of fundamental algorithms, that can be applied to solving concrete, NP-hard problems. In particular, we introduce the concept of a quantum dictionary as a summation of multiple patterns and algorithms, and show how it can be applied in the context of Quadratic Unconstrained Binary Optimization (QUBO) problems. We start by presenting a visual approach to quantum computing, which avoids a heavy-reliance on quantum mechanics, linear algebra, or complex mathematical notation, and favors geometrical intuition and computing paradigms. We also provide insights on the fundamental quantum computing algorithms (Fourier Transforms, Phase Estimation, Grover, Quantum Counting, and Amplitude Estimation).
△ Less
Submitted 25 January, 2021; v1 submitted 23 July, 2019;
originally announced July 2019.
-
Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivation
Authors:
Tejas D. Kulkarni,
Karthik R. Narasimhan,
Ardavan Saeedi,
Joshua B. Tenenbaum
Abstract:
Learning goal-directed behavior in environments with sparse feedback is a major challenge for reinforcement learning algorithms. The primary difficulty arises due to insufficient exploration, resulting in an agent being unable to learn robust value functions. Intrinsically motivated agents can explore new behavior for its own sake rather than to directly solve problems. Such intrinsic behaviors co…
▽ More
Learning goal-directed behavior in environments with sparse feedback is a major challenge for reinforcement learning algorithms. The primary difficulty arises due to insufficient exploration, resulting in an agent being unable to learn robust value functions. Intrinsically motivated agents can explore new behavior for its own sake rather than to directly solve problems. Such intrinsic behaviors could eventually help the agent solve tasks posed by the environment. We present hierarchical-DQN (h-DQN), a framework to integrate hierarchical value functions, operating at different temporal scales, with intrinsically motivated deep reinforcement learning. A top-level value function learns a policy over intrinsic goals, and a lower-level function learns a policy over atomic actions to satisfy the given goals. h-DQN allows for flexible goal specifications, such as functions over entities and relations. This provides an efficient space for exploration in complicated environments. We demonstrate the strength of our approach on two problems with very sparse, delayed feedback: (1) a complex discrete stochastic decision process, and (2) the classic ATARI game `Montezuma's Revenge'.
△ Less
Submitted 31 May, 2016; v1 submitted 20 April, 2016;
originally announced April 2016.
-
A new Loan-Stock Financial Instrument
Authors:
Alexander Morozovsky,
Rajan Narasimhan,
Yuri Kholodenko
Abstract:
A new financial instrument (a new kind of a loan) is introduced. The loan-stock instrument (LSI) combines fixed rate instruments (loans, etc.) with other financial instruments that have higher volatilities and returns (stocks, mutual funds, currencies, derivatives, options, etc.). This new loan depends on the value of underlying security (for example, stock) in such a way that when underlying se…
▽ More
A new financial instrument (a new kind of a loan) is introduced. The loan-stock instrument (LSI) combines fixed rate instruments (loans, etc.) with other financial instruments that have higher volatilities and returns (stocks, mutual funds, currencies, derivatives, options, etc.). This new loan depends on the value of underlying security (for example, stock) in such a way that when underlying security increases, the value of loan decreases and backwards. The procedure to create a risk free portfolio and a technique to fairly price the LSI is described. The philosophy behind this procedure is quite similar to the Black-Scholes formalism in option theory. Creation of the risk free portfolio is possible because the change in the underlying security offsets the change in the value of the loan (or the amount that the borrower has to repay). The new financial instrument takes an advantage of the fact that on average the stock market grows in time. It is beneficial for both the borrower and the lender. The LSI is more attractive for the borrower than the traditional loan is due to the decrease in the amount that has to be repaid. This attractiveness constitutes the benefit for the lender in terms of the market share among the borrowers. In addition, the lender can charge the extra premium.
△ Less
Submitted 30 June, 2000;
originally announced July 2000.
