Showing 1–1 of 1 results for author: Halvari, T

Testing the Robustness of AutoML Systems

Authors: Tuomas Halvari, Jukka K. Nurminen, Tommi Mikkonen

Abstract: Automated machine learning (AutoML) systems aim at finding the best machine learning (ML) pipeline that automatically matches the task and data at hand. We investigate the robustness of machine learning pipelines generated with three AutoML systems, TPOT, H2O, and AutoKeras. In particular, we study the influence of dirty data on accuracy, and consider how using dirty training data may help create… ▽ More Automated machine learning (AutoML) systems aim at finding the best machine learning (ML) pipeline that automatically matches the task and data at hand. We investigate the robustness of machine learning pipelines generated with three AutoML systems, TPOT, H2O, and AutoKeras. In particular, we study the influence of dirty data on accuracy, and consider how using dirty training data may help create more robust solutions. Furthermore, we also analyze how the structure of the generated pipelines differs in different cases. △ Less

Submitted 22 July, 2020; v1 submitted 6 May, 2020; originally announced May 2020.

Comments: In Proceedings AREA 2020, arXiv:2007.11260

Journal ref: EPTCS 319, 2020, pp. 103-116