We gratefully acknowledge support from
the Simons Foundation and member institutions.

Kevin Clark is qualified to endorse.

Pre-Training Transformers as Energy-Based Cloze Models

Kevin Clark: Is registered as an author of this paper.
Can endorse for cs.CL, cs.CV, cs.LG. (why?)

Minh-Thang Luong, Quoc V. Le and Christopher D. Manning are not registered as owners of this paper. (why?)