-
Agree to Disagree: Measuring Hidden Dissents in FOMC Meetings
Authors:
Kwok ** Tsang,
Zichao Yang
Abstract:
Based on a record of dissents on FOMC votes and transcripts of the meetings from 1976 to 2017, we develop a deep learning model based on self-attention mechanism to create a measure of disagreement for members in each meeting. While dissents are rare, we find that members often have reservations with the policy decision, and the level of disagreement is mostly driven by current or predicted macroe…
▽ More
Based on a record of dissents on FOMC votes and transcripts of the meetings from 1976 to 2017, we develop a deep learning model based on self-attention mechanism to create a measure of disagreement for members in each meeting. While dissents are rare, we find that members often have reservations with the policy decision, and the level of disagreement is mostly driven by current or predicted macroeconomic data. Using our model to evaluate speeches made by members between meetings, we find that the informational content of speeches is low if we can only compare them to speeches made by the chair. Disagreement strongly correlates with data from the Summary of Economic Projections and a measure of monetary policy sub-optimality, suggesting that disagreement is driven by both members' different preferences and their different views about the future.
△ Less
Submitted 6 March, 2024; v1 submitted 19 August, 2023;
originally announced August 2023.
-
Exploring the Nexus between Exhaustible Human Resources and Economic Development in China: An Application of the Hotelling Model
Authors:
Zhiwei Yang
Abstract:
This paper applies the Hotelling model to the context of exhaustible human resources in China. We find that over-exploitation of human resources occurs under conditions of restricted population mobility, rigid wage levels, and increased foreign trade demand elasticity. Conversely, the existence of technological replacements for human resources or improvements in the utilization rate of human resou…
▽ More
This paper applies the Hotelling model to the context of exhaustible human resources in China. We find that over-exploitation of human resources occurs under conditions of restricted population mobility, rigid wage levels, and increased foreign trade demand elasticity. Conversely, the existence of technological replacements for human resources or improvements in the utilization rate of human resources leads to conservation. Our analysis provides practical insights for policy-making towards sustainable development.
△ Less
Submitted 21 June, 2023;
originally announced August 2023.
-
Learning to Incentivize Information Acquisition: Proper Scoring Rules Meet Principal-Agent Model
Authors:
Siyu Chen,
Jibang Wu,
Yifan Wu,
Zhuoran Yang
Abstract:
We study the incentivized information acquisition problem, where a principal hires an agent to gather information on her behalf. Such a problem is modeled as a Stackelberg game between the principal and the agent, where the principal announces a scoring rule that specifies the payment, and then the agent then chooses an effort level that maximizes her own profit and reports the information. We stu…
▽ More
We study the incentivized information acquisition problem, where a principal hires an agent to gather information on her behalf. Such a problem is modeled as a Stackelberg game between the principal and the agent, where the principal announces a scoring rule that specifies the payment, and then the agent then chooses an effort level that maximizes her own profit and reports the information. We study the online setting of such a problem from the principal's perspective, i.e., designing the optimal scoring rule by repeatedly interacting with the strategic agent. We design a provably sample efficient algorithm that tailors the UCB algorithm (Auer et al., 2002) to our model, which achieves a sublinear $T^{2/3}$-regret after $T$ iterations. Our algorithm features a delicate estimation procedure for the optimal profit of the principal, and a conservative correction scheme that ensures the desired agent's actions are incentivized. Furthermore, a key feature of our regret bound is that it is independent of the number of states of the environment.
△ Less
Submitted 6 August, 2023; v1 submitted 15 March, 2023;
originally announced March 2023.
-
Finding Regularized Competitive Equilibria of Heterogeneous Agent Macroeconomic Models with Reinforcement Learning
Authors:
Ruitu Xu,
Yifei Min,
Tianhao Wang,
Zhaoran Wang,
Michael I. Jordan,
Zhuoran Yang
Abstract:
We study a heterogeneous agent macroeconomic model with an infinite number of households and firms competing in a labor market. Each household earns income and engages in consumption at each time step while aiming to maximize a concave utility subject to the underlying market conditions. The households aim to find the optimal saving strategy that maximizes their discounted cumulative utility given…
▽ More
We study a heterogeneous agent macroeconomic model with an infinite number of households and firms competing in a labor market. Each household earns income and engages in consumption at each time step while aiming to maximize a concave utility subject to the underlying market conditions. The households aim to find the optimal saving strategy that maximizes their discounted cumulative utility given the market condition, while the firms determine the market conditions through maximizing corporate profit based on the household population behavior. The model captures a wide range of applications in macroeconomic studies, and we propose a data-driven reinforcement learning framework that finds the regularized competitive equilibrium of the model. The proposed algorithm enjoys theoretical guarantees in converging to the equilibrium of the market at a sub-linear rate.
△ Less
Submitted 24 February, 2023;
originally announced March 2023.
-
The Sample Complexity of Online Contract Design
Authors:
Banghua Zhu,
Stephen Bates,
Zhuoran Yang,
Yixin Wang,
Jiantao Jiao,
Michael I. Jordan
Abstract:
We study the hidden-action principal-agent problem in an online setting. In each round, the principal posts a contract that specifies the payment to the agent based on each outcome. The agent then makes a strategic choice of action that maximizes her own utility, but the action is not directly observable by the principal. The principal observes the outcome and receives utility from the agent's cho…
▽ More
We study the hidden-action principal-agent problem in an online setting. In each round, the principal posts a contract that specifies the payment to the agent based on each outcome. The agent then makes a strategic choice of action that maximizes her own utility, but the action is not directly observable by the principal. The principal observes the outcome and receives utility from the agent's choice of action. Based on past observations, the principal dynamically adjusts the contracts with the goal of maximizing her utility.
We introduce an online learning algorithm and provide an upper bound on its Stackelberg regret. We show that when the contract space is $[0,1]^m$, the Stackelberg regret is upper bounded by $\widetilde O(\sqrt{m} \cdot T^{1-1/(2m+1)})$, and lower bounded by $Ω(T^{1-1/(m+2)})$, where $\widetilde O$ omits logarithmic factors. This result shows that exponential-in-$m$ samples are sufficient and necessary to learn a near-optimal contract, resolving an open problem on the hardness of online contract design. Moreover, when contracts are restricted to some subset $\mathcal{F} \subset [0,1]^m$, we define an intrinsic dimension of $\mathcal{F}$ that depends on the covering number of the spherical code in the space and bound the regret in terms of this intrinsic dimension. When $\mathcal{F}$ is the family of linear contracts, we show that the Stackelberg regret grows exactly as $Θ(T^{2/3})$.
The contract design problem is challenging because the utility function is discontinuous. Bounding the discretization error in this setting has been an open problem. In this paper, we identify a limited set of directions in which the utility function is continuous, allowing us to design a new discretization method and bound its error. This approach enables the first upper bound with no restrictions on the contract and action space.
△ Less
Submitted 19 May, 2023; v1 submitted 10 November, 2022;
originally announced November 2022.
-
Sequential Information Design: Markov Persuasion Process and Its Efficient Reinforcement Learning
Authors:
Jibang Wu,
Zixuan Zhang,
Zhe Feng,
Zhaoran Wang,
Zhuoran Yang,
Michael I. Jordan,
Haifeng Xu
Abstract:
In today's economy, it becomes important for Internet platforms to consider the sequential information design problem to align its long term interest with incentives of the gig service providers. This paper proposes a novel model of sequential information design, namely the Markov persuasion processes (MPPs), where a sender, with informational advantage, seeks to persuade a stream of myopic receiv…
▽ More
In today's economy, it becomes important for Internet platforms to consider the sequential information design problem to align its long term interest with incentives of the gig service providers. This paper proposes a novel model of sequential information design, namely the Markov persuasion processes (MPPs), where a sender, with informational advantage, seeks to persuade a stream of myopic receivers to take actions that maximizes the sender's cumulative utilities in a finite horizon Markovian environment with varying prior and utility functions. Planning in MPPs thus faces the unique challenge in finding a signaling policy that is simultaneously persuasive to the myopic receivers and inducing the optimal long-term cumulative utilities of the sender. Nevertheless, in the population level where the model is known, it turns out that we can efficiently determine the optimal (resp. $ε$-optimal) policy with finite (resp. infinite) states and outcomes, through a modified formulation of the Bellman equation.
Our main technical contribution is to study the MPP under the online reinforcement learning (RL) setting, where the goal is to learn the optimal signaling policy by interacting with with the underlying MPP, without the knowledge of the sender's utility functions, prior distributions, and the Markov transition kernels. We design a provably efficient no-regret learning algorithm, the Optimism-Pessimism Principle for Persuasion Process (OP4), which features a novel combination of both optimism and pessimism principles. Our algorithm enjoys sample efficiency by achieving a sublinear $\sqrt{T}$-regret upper bound. Furthermore, both our algorithm and theory can be applied to MPPs with large space of outcomes and states via function approximation, and we showcase such a success under the linear setting.
△ Less
Submitted 22 February, 2022;
originally announced February 2022.
-
Equal Predictive Ability Tests Based on Panel Data with Applications to OECD and IMF Forecasts
Authors:
Oguzhan Akgun,
Alain Pirotte,
Giovanni Urga,
Zhenlin Yang
Abstract:
We propose two types of equal predictive ability (EPA) tests with panels to compare the predictions made by two forecasters. The first type, namely $S$-statistics, focuses on the overall EPA hypothesis which states that the EPA holds on average over all panel units and over time. The second, called $C$-statistics, focuses on the clustered EPA hypothesis where the EPA holds jointly for a fixed numb…
▽ More
We propose two types of equal predictive ability (EPA) tests with panels to compare the predictions made by two forecasters. The first type, namely $S$-statistics, focuses on the overall EPA hypothesis which states that the EPA holds on average over all panel units and over time. The second, called $C$-statistics, focuses on the clustered EPA hypothesis where the EPA holds jointly for a fixed number of clusters of panel units. The asymptotic properties of the proposed tests are evaluated under weak and strong cross-sectional dependence. An extensive Monte Carlo simulation shows that the proposed tests have very good finite sample properties even with little information about the cross-sectional dependence in the data. The proposed framework is applied to compare the economic growth forecasts of the OECD and the IMF, and to evaluate the performance of the consumer price inflation forecasts of the IMF.
△ Less
Submitted 6 February, 2023; v1 submitted 5 March, 2020;
originally announced March 2020.
