Skip to main content

Showing 1–16 of 16 results for author: van de Ven, G M

.
  1. arXiv:2405.04101  [pdf, other

    cs.LG cs.AI

    Continual Learning in the Presence of Repetition

    Authors: Hamed Hemati, Lorenzo Pellegrini, Xiaotian Duan, Zixuan Zhao, Fangfang Xia, Marc Masana, Benedikt Tscheschner, Eduardo Veas, Yuxiang Zheng, Shiji Zhao, Shao-Yuan Li, Sheng-Jun Huang, Vincenzo Lomonaco, Gido M. van de Ven

    Abstract: Continual learning (CL) provides a framework for training models in ever-evolving environments. Although re-occurrence of previously seen objects or tasks is common in real-world problems, the concept of repetition in the data stream is not often considered in standard benchmarks for CL. Unlike with the rehearsal mechanism in buffer-based strategies, where sample repetition is controlled by the st… ▽ More

    Submitted 7 May, 2024; originally announced May 2024.

    Comments: Preprint; Challenge Report of the 4th Workshop on Continual Learning in Computer Vision at CVPR

  2. arXiv:2403.05175  [pdf, other

    cs.LG cs.AI cs.CV q-bio.NC stat.ML

    Continual Learning and Catastrophic Forgetting

    Authors: Gido M. van de Ven, Nicholas Soures, Dhireesha Kudithipudi

    Abstract: This book chapter delves into the dynamics of continual learning, which is the process of incrementally learning from a non-stationary stream of data. Although continual learning is a natural skill for the human brain, it is very challenging for artificial neural networks. An important reason is that, when learning something new, these networks tend to quickly and drastically forget what they had… ▽ More

    Submitted 8 March, 2024; originally announced March 2024.

    Comments: Preprint of a book chapter; 21 pages, 4 figures

  3. arXiv:2312.16731  [pdf, other

    cs.LG cs.CV

    Infinite dSprites for Disentangled Continual Learning: Separating Memory Edits from Generalization

    Authors: Sebastian Dziadzio, Çağatay Yıldız, Gido M. van de Ven, Tomasz Trzciński, Tinne Tuytelaars, Matthias Bethge

    Abstract: The ability of machine learning systems to learn continually is hindered by catastrophic forgetting, the tendency of neural networks to overwrite existing knowledge when learning a new task. Continual learning methods alleviate this problem through regularization, parameter isolation, or rehearsal, but they are typically evaluated on benchmarks comprising only a handful of tasks. In contrast, huma… ▽ More

    Submitted 29 February, 2024; v1 submitted 27 December, 2023; originally announced December 2023.

    Comments: 10 pages, 10 figures

  4. arXiv:2311.14028  [pdf, other

    cs.LG cs.AI cs.CV

    Continual Learning of Diffusion Models with Generative Distillation

    Authors: Sergi Masip, Pau Rodriguez, Tinne Tuytelaars, Gido M. van de Ven

    Abstract: Diffusion models are powerful generative models that achieve state-of-the-art performance in image synthesis. However, training them demands substantial amounts of data and computational resources. Continual learning would allow for incrementally learning new tasks and accumulating knowledge, thus enabling the reuse of trained models for further learning. One potentially suitable continual learnin… ▽ More

    Submitted 20 May, 2024; v1 submitted 23 November, 2023; originally announced November 2023.

    Comments: To appear in the Proceedings of the Third Conference on Lifelong Learning Agents (CoLLAs), 2024

  5. arXiv:2311.11908  [pdf, other

    cs.LG cs.AI cs.CV

    Continual Learning: Applications and the Road Forward

    Authors: Eli Verwimp, Rahaf Aljundi, Shai Ben-David, Matthias Bethge, Andrea Cossu, Alexander Gepperth, Tyler L. Hayes, Eyke Hüllermeier, Christopher Kanan, Dhireesha Kudithipudi, Christoph H. Lampert, Martin Mundt, Razvan Pascanu, Adrian Popescu, Andreas S. Tolias, Joost van de Weijer, Bing Liu, Vincenzo Lomonaco, Tinne Tuytelaars, Gido M. van de Ven

    Abstract: Continual learning is a subfield of machine learning, which aims to allow machine learning models to continuously learn on new data, by accumulating knowledge without forgetting what was learned in the past. In this work, we take a step back, and ask: "Why should one care about continual learning in the first place?". We set the stage by examining recent continual learning papers published at four… ▽ More

    Submitted 28 March, 2024; v1 submitted 20 November, 2023; originally announced November 2023.

    Journal ref: Transactions on Machine Learning Research (TMLR), 2024

  6. arXiv:2311.04898  [pdf, other

    cs.LG cs.AI cs.CV stat.ML

    Two Complementary Perspectives to Continual Learning: Ask Not Only What to Optimize, But Also How

    Authors: Timm Hess, Tinne Tuytelaars, Gido M. van de Ven

    Abstract: Recent years have seen considerable progress in the continual training of deep neural networks, predominantly thanks to approaches that add replay or regularization terms to the loss function to approximate the joint loss over all tasks so far. However, we show that even with a perfect approximation to the joint loss, these approaches still suffer from temporary but substantial forgetting when sta… ▽ More

    Submitted 21 June, 2024; v1 submitted 8 November, 2023; originally announced November 2023.

    Comments: Full paper version of pre-registered report accepted at the 1st ContinualAI Unconference. The originally submitted pre-registered proposal can be found at arXiv:2311.04898v1

  7. arXiv:2305.18806  [pdf, other

    cs.LG cs.AI cs.CV stat.ML

    Prediction Error-based Classification for Class-Incremental Learning

    Authors: Michał Zając, Tinne Tuytelaars, Gido M. van de Ven

    Abstract: Class-incremental learning (CIL) is a particularly challenging variant of continual learning, where the goal is to learn to discriminate between all classes presented in an incremental fashion. Existing approaches often suffer from excessive forgetting and imbalance of the scores assigned to classes that have not been seen together during training. In this study, we introduce a novel approach, Pre… ▽ More

    Submitted 9 March, 2024; v1 submitted 30 May, 2023; originally announced May 2023.

    Comments: ICLR 2024 camera ready

  8. arXiv:2304.00933  [pdf, other

    cs.LG cs.CV

    Knowledge Accumulation in Continually Learned Representations and the Issue of Feature Forgetting

    Authors: Timm Hess, Eli Verwimp, Gido M. van de Ven, Tinne Tuytelaars

    Abstract: Continual learning research has shown that neural networks suffer from catastrophic forgetting "at the output level", but it is debated whether this is also the case at the level of learned representations. Multiple recent studies ascribe representations a certain level of innate robustness against forgetting -- that they only forget minimally in comparison with forgetting at the output level. We… ▽ More

    Submitted 24 June, 2024; v1 submitted 3 April, 2023; originally announced April 2023.

    Comments: TMLR 2024

    Journal ref: Transactions on Machine Learning Research (TMLR), 2024

  9. arXiv:2106.08085  [pdf, other

    cs.LG q-bio.NC

    Natural continual learning: success is a journey, not (just) a destination

    Authors: Ta-Chu Kao, Kristopher T. Jensen, Gido M. van de Ven, Alberto Bernacchia, Guillaume Hennequin

    Abstract: Biological agents are known to learn many different tasks over the course of their lives, and to be able to revisit previous tasks and behaviors with little to no loss in performance. In contrast, artificial agents are prone to 'catastrophic forgetting' whereby performance on previous tasks deteriorates rapidly as new ones are acquired. This shortcoming has recently been addressed using methods th… ▽ More

    Submitted 15 December, 2021; v1 submitted 15 June, 2021; originally announced June 2021.

    Comments: NeurIPS 2021 camera-ready version

  10. arXiv:2104.10093  [pdf, other

    cs.LG cs.AI cs.CV stat.ML

    Class-Incremental Learning with Generative Classifiers

    Authors: Gido M. van de Ven, Zhe Li, Andreas S. Tolias

    Abstract: Incrementally training deep neural networks to recognize new classes is a challenging problem. Most existing class-incremental learning methods store data or use generative replay, both of which have drawbacks, while 'rehearsal-free' alternatives such as parameter regularization or bias-correction methods do not consistently achieve high performance. Here, we put forward a new strategy for class-i… ▽ More

    Submitted 28 April, 2021; v1 submitted 20 April, 2021; originally announced April 2021.

    Comments: To appear in the IEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPR-W) on Continual Learning in Computer Vision (CLVision) 2021

    Journal ref: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2021, pp. 3611-3620

  11. arXiv:2011.12216  [pdf, other

    cs.LG cs.AI stat.ML

    Energy-Based Models for Continual Learning

    Authors: Shuang Li, Yilun Du, Gido M. van de Ven, Igor Mordatch

    Abstract: We motivate Energy-Based Models (EBMs) as a promising model class for continual learning problems. Instead of tackling continual learning via the use of external memory, growing models, or regularization, EBMs change the underlying training objective to cause less interference with previously learned information. Our proposed version of EBMs for continual learning is simple, efficient, and outperf… ▽ More

    Submitted 18 December, 2022; v1 submitted 24 November, 2020; originally announced November 2020.

    Comments: Project page: https://energy-based-model.github.io/Energy-Based-Models-for-Continual-Learning

    Journal ref: Proceedings of The 1st Conference on Lifelong Learning Agents (CoLLAs), 2022, pp. 1-22

  12. arXiv:2004.12908  [pdf, other

    cs.AI cs.LG stat.ML

    A Simple Lifelong Learning Approach

    Authors: Joshua T. Vogelstein, Jayanta Dey, Hayden S. Helm, Will LeVine, Ronak D. Mehta, Tyler M. Tomita, Haoyin Xu, Ali Geisa, Qingyang Wang, Gido M. van de Ven, Chenyu Gao, Weiwei Yang, Bryan Tower, Jonathan Larson, Christopher M. White, Carey E. Priebe

    Abstract: In lifelong learning, data are used to improve performance not only on the present task, but also on past and future (unencountered) tasks. While typical transfer learning algorithms can improve performance on future tasks, their performance on prior tasks degrades upon learning new tasks (called forgetting). Many recent approaches for continual or lifelong learning have attempted to maintain perf… ▽ More

    Submitted 11 June, 2024; v1 submitted 27 April, 2020; originally announced April 2020.

  13. arXiv:1904.07734  [pdf, other

    cs.LG cs.AI cs.CV stat.ML

    Three scenarios for continual learning

    Authors: Gido M. van de Ven, Andreas S. Tolias

    Abstract: Standard artificial neural networks suffer from the well-known issue of catastrophic forgetting, making continual or lifelong learning difficult for machine learning. In recent years, numerous methods have been proposed for continual learning, but due to differences in evaluation protocols it is difficult to directly compare their performance. To enable more structured comparisons, we describe thr… ▽ More

    Submitted 15 April, 2019; originally announced April 2019.

    Comments: Extended version of work presented at the NeurIPS Continual Learning workshop (2018); 18 pages, 5 figures, 6 tables. Related to arXiv:1809.10635

  14. arXiv:1809.10635  [pdf, other

    cs.LG cs.AI cs.CV stat.ML

    Generative replay with feedback connections as a general strategy for continual learning

    Authors: Gido M. van de Ven, Andreas S. Tolias

    Abstract: A major obstacle to develo** artificial intelligence applications capable of true lifelong learning is that artificial neural networks quickly or catastrophically forget previously learned tasks when trained on a new one. Numerous methods for alleviating catastrophic forgetting are currently being proposed, but differences in evaluation protocols make it difficult to directly compare their perfo… ▽ More

    Submitted 17 April, 2019; v1 submitted 27 September, 2018; originally announced September 2018.

    Comments: 17 pages, 8 figures, 4 tables

  15. arXiv:1505.07315  [pdf, ps, other

    cond-mat.soft

    Stability and folds in an elastocapillary system

    Authors: Amir Akbari, Reghan J. Hill, Theo G. M. van de Ven

    Abstract: We examine the equilibrium and stability of an elastocapillary system to model drying-induced structural failures. The model comprises a circular elastic membrane with a hole at the center that is deformed by the capillary pressure of simply connected and doubly connected menisci. Using variational and spectral methods, stability is related to the slope of equilibrium branches in the liquid conten… ▽ More

    Submitted 27 May, 2015; originally announced May 2015.

  16. arXiv:1505.07159  [pdf, ps, other

    cond-mat.soft

    Catenoid stability with a free contact line

    Authors: Amir Akbari, Reghan J. Hill, Theo G. M. van de Ven

    Abstract: Contact-drop dispensing is central to many small-scale applications, such as direct-scanning probe lithography and micromachined fountain-pen techniques. Accurate and controllable dispensing required for nanometer-resolved surface patterning hinges on the stability and breakup of liquid bridges. Here, we analytically study the stability of catenoids pinned at one contact line with the other free t… ▽ More

    Submitted 26 May, 2015; originally announced May 2015.