Adjusting for Bias with Procedural Data
Authors:
Shesh Narayan Gupta,
Nicholas Bear Brown
Abstract:
3D softwares are now capable of producing highly realistic images that look nearly indistinguishable from the real images. This raises the question: can real datasets be enhanced with 3D rendered data? We investigate this question. In this paper we demonstrate the use of 3D rendered data, procedural, data for the adjustment of bias in image datasets. We perform error analysis of images of animals…
▽ More
3D softwares are now capable of producing highly realistic images that look nearly indistinguishable from the real images. This raises the question: can real datasets be enhanced with 3D rendered data? We investigate this question. In this paper we demonstrate the use of 3D rendered data, procedural, data for the adjustment of bias in image datasets. We perform error analysis of images of animals which shows that the misclassification of some animal breeds is largely a data issue. We then create procedural images of the poorly classified breeds and that model further trained on procedural data can better classify poorly performing breeds on real data. We believe that this approach can be used for the enhancement of visual data for any underrepresented group, including rare diseases, or any data bias potentially improving the accuracy and fairness of models. We find that the resulting representations rival or even out-perform those learned directly from real data, but that good performance requires care in the 3D rendered procedural data generation. 3D image dataset can be viewed as a compressed and organized copy of a real dataset, and we envision a future where more and more procedural data proliferate while datasets become increasingly unwieldy, missing, or private. This paper suggests several techniques for dealing with visual representation learning in such a future.
△ Less
Submitted 4 April, 2022; v1 submitted 3 April, 2022;
originally announced April 2022.
TensorFlow.js: Machine Learning for the Web and Beyond
Authors:
Daniel Smilkov,
Nikhil Thorat,
Yannick Assogba,
Ann Yuan,
Nick Kreeger,
** Yu,
Kangyi Zhang,
Shanqing Cai,
Eric Nielsen,
David Soergel,
Stan Bileschi,
Michael Terry,
Charles Nicholson,
Sandeep N. Gupta,
Sarah Sirajuddin,
D. Sculley,
Rajat Monga,
Greg Corrado,
Fernanda B. Viégas,
Martin Wattenberg
Abstract:
TensorFlow.js is a library for building and executing machine learning algorithms in JavaScript. TensorFlow.js models run in a web browser and in the Node.js environment. The library is part of the TensorFlow ecosystem, providing a set of APIs that are compatible with those in Python, allowing models to be ported between the Python and JavaScript ecosystems. TensorFlow.js has empowered a new set o…
▽ More
TensorFlow.js is a library for building and executing machine learning algorithms in JavaScript. TensorFlow.js models run in a web browser and in the Node.js environment. The library is part of the TensorFlow ecosystem, providing a set of APIs that are compatible with those in Python, allowing models to be ported between the Python and JavaScript ecosystems. TensorFlow.js has empowered a new set of developers from the extensive JavaScript community to build and deploy machine learning models and enabled new classes of on-device computation. This paper describes the design, API, and implementation of TensorFlow.js, and highlights some of the impactful use cases.
△ Less
Submitted 27 February, 2019; v1 submitted 16 January, 2019;
originally announced January 2019.
