-
Retrain or not retrain: Conformal test martingales for change-point detection
Abstract: We argue for supplementing the process of training a prediction algorithm by setting up a scheme for detecting the moment when the distribution of the data changes and the algorithm needs to be retrained. Our proposed schemes are based on exchangeability martingales, i.e., processes that are martingales under any exchangeable distribution for the data. Our method, based on conformal prediction, is… ▽ More
Submitted 20 February, 2021; originally announced February 2021.
Comments: 22 pages, 19 figures, 3 tables
MSC Class: 68Q32 (Primary) 62G10; 60G42; 68T05 (Secondary)