We gratefully acknowledge support from
the Simons Foundation and member institutions.

Qian Liu is qualified to endorse.

RegMix: Data Mixture as Regression for Language Model Pre-training

Qian Liu: Is registered as an author of this paper.
Can endorse for cs.AI, cs.CL, cs.LG, cs.SC. (why?)

Xiaosen Zheng, Niklas Muennighoff, Guangtao Zeng, Longxu Dou, Tianyu Pang, **g Jiang and Min Lin are not registered as owners of this paper. (why?)