Showing 1–1 of 1 results for author: Zinkevich, M

Slow Learners are Fast

Authors: John Langford, Alexander Smola, Martin Zinkevich

Abstract: Online learning algorithms have impressive convergence properties when it comes to risk minimization and convex games on very large problems. However, they are inherently sequential in their design which prevents them from taking advantage of modern multi-core architectures. In this paper we prove that online learning with delayed updates converges well, thereby facilitating parallel online lear… ▽ More Online learning algorithms have impressive convergence properties when it comes to risk minimization and convex games on very large problems. However, they are inherently sequential in their design which prevents them from taking advantage of modern multi-core architectures. In this paper we prove that online learning with delayed updates converges well, thereby facilitating parallel online learning. △ Less

Submitted 3 November, 2009; originally announced November 2009.

Comments: Extended version of conference paper - NIPS 2009

MSC Class: 49M30; 80M50