Split Conformal Prediction for Dependent Data
Authors:
Roberto I. Oliveira,
Paulo Orenstein,
Thiago Ramos,
João Vitor Romano
Abstract:
Split conformal prediction is a popular tool to obtain predictive intervals from general statistical algorithms, with few assumptions beyond data exchangeability. We show that coverage guarantees from split CP can be extended to dependent processes, such as the class of stationary $β$-mixing processes, by adding a small coverage penalty. In particular, we show that the empirical coverage bounds fo…
▽ More
Split conformal prediction is a popular tool to obtain predictive intervals from general statistical algorithms, with few assumptions beyond data exchangeability. We show that coverage guarantees from split CP can be extended to dependent processes, such as the class of stationary $β$-mixing processes, by adding a small coverage penalty. In particular, we show that the empirical coverage bounds for some $β$-mixing processes match the order of the bounds under exchangeability. The framework introduced also extends to non-stationary processes and to other CP methods, and experiments corroborate our split CP's coverage guarantees under dependent data.
△ Less
Submitted 29 March, 2022;
originally announced March 2022.
A New Era: Intelligent Tutoring Systems Will Transform Online Learning for Millions
Authors:
Francois St-Hilaire,
Dung Do Vu,
Antoine Frau,
Nathan Burns,
Farid Faraji,
Joseph Potochny,
Stephane Robert,
Arnaud Roussel,
Selene Zheng,
Taylor Glazier,
Junfel Vincent Romano,
Robert Belfer,
Muhammad Shayan,
Ariella Smofsky,
Tommy Delarosbil,
Seulmin Ahn,
Simon Eden-Walker,
Kritika Sony,
Ansona Onyi Ching,
Sabina Elkins,
Anush Stepanyan,
Adela Matajova,
Victor Chen,
Hossein Sahraei,
Robert Larson
, et al. (6 additional authors not shown)
Abstract:
Despite artificial intelligence (AI) having transformed major aspects of our society, less than a fraction of its potential has been explored, let alone deployed, for education. AI-powered learning can provide millions of learners with a highly personalized, active and practical learning experience, which is key to successful learning. This is especially relevant in the context of online learning…
▽ More
Despite artificial intelligence (AI) having transformed major aspects of our society, less than a fraction of its potential has been explored, let alone deployed, for education. AI-powered learning can provide millions of learners with a highly personalized, active and practical learning experience, which is key to successful learning. This is especially relevant in the context of online learning platforms. In this paper, we present the results of a comparative head-to-head study on learning outcomes for two popular online learning platforms (n=199 participants): A MOOC platform following a traditional model delivering content using lecture videos and multiple-choice quizzes, and the Korbit learning platform providing a highly personalized, active and practical learning experience. We observe a huge and statistically significant increase in the learning outcomes, with students on the Korbit platform providing full feedback resulting in higher course completion rates and achieving learning gains 2 to 2.5 times higher than both students on the MOOC platform and students in a control group who don't receive personalized feedback on the Korbit platform. The results demonstrate the tremendous impact that can be achieved with a personalized, active learning AI-powered system. Making this technology and learning experience available to millions of learners around the world will represent a significant leap forward towards the democratization of education.
△ Less
Submitted 3 March, 2022;
originally announced March 2022.
