NeurIPS 2024 Past Large language models

NeurIPS 2024 Workshop on Scalable Continual Learning for Lifelong Foundation Models

Continual FoMo

Submission deadline
Sep 22, 2024, 10:00 UTC
imported from OpenReview — check the website for extensions
Submission portal
OpenReview
Notes
Auto-imported from the OpenReview venue record on 2026-06-10 — please verify and enrich (topics are keyword-guessed).

Accepted papers (16)

Fetched from OpenReview (v2) on 2026-06-10.

  1. A Practitioner's Guide to Continual Multimodal Pretraining

    Karsten Roth, Vishaal Udandarao, Sebastian Dziadzio, Ameya Prabhu, Mehdi Cherti, Oriol Vinyals, Olivier J Henaff, Samuel Albanie, Matthias Bethge, Zeynep Akata · PDF
  2. Agent Skill Acquisition for Large Language Models via CycleQD

    So Kuroki, Taishi Nakamura, Takuya Akiba, Yujin Tang · PDF
  3. Casper : Cascading Hypernetworks for Scalable Continual Learning

    Tej Pandit, Dhireesha Kudithipudi · PDF
  4. CLoG: Benchmarking Continual Learning of Image Generation Models

    Haotian Zhang, Junting Zhou, Haowei Lin, Hang Ye, Jianhua Zhu, Zihao Wang, Liangcai Gao, Yizhou Wang, Yitao Liang · PDF
  5. Continual Learning of Foundation Models with Limited Labelled Data

    Shuvendu Roy, Elham Dolatabadi, Arash Afkanpour, Ali Etemad · PDF
  6. CUAL: Continual Uncertainty-aware Active Learner

    Amanda Sofie Rios, Ibrahima Jacques Ndiour, Jaroslaw Sydir, Parual Datta, Omesh Tickoo, Nilesh Ahuja · PDF
  7. Demystifying Language Model Forgetting with Low-Rank Example Associations

    Xisen Jin, Xiang Ren · PDF
  8. Differentially Private Continual Learning using Pre-Trained Models

    Marlon Tobaben, Marcus Klasson, Rui Li, Arno Solin, Antti Honkela · PDF
  9. Exploring Continual Fine-Tuning for Enhancing Language Ability in Large Language Model

    Divyanshu Aggarwal, Sankarshan Damle, Navin Goyal, Satya Lokam, Sunayana Sitaram · PDF
  10. Exploring the Limits of Feature Learning in Continual Learning

    Jacopo Graldi, Giulia Lanzillotta, Lorenzo Noci, Benjamin F Grewe, Thomas Hofmann · PDF
  11. Foundation Models Meet Continual Learning: Recent Advances, Challenges, and Future Directions

    Tarun Raheja, Nilay Pochhi · PDF
  12. Improving Multimodal Large Language Models Using Continual Learning

    Shikhar Srivastava, Md Yousuf Harun, Robik Singh Shrestha, Christopher Kanan · PDF
  13. Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptation

    Xiwen Wei, Guihong Li, Radu Marculescu · PDF
  14. Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning

    Huiyi Wang, Haodong Lu, Lina Yao, Dong Gong · PDF
  15. Testing the limits of data efficiency in experience replay

    Damiano Meier, Giulia Lanzillotta, Thomas Hofmann · PDF
  16. TiC-LM: A Multi-Year Benchmark for Continual Pretraining of Language Models

    Jeffrey Li, Mohammadreza Armandpour, Seyed Iman Mirzadeh, Sachin Mehta, Vaishaal Shankar, Raviteja Vemulapalli, Oncel Tuzel, Mehrdad Farajtabar, Hadi Pouransari, Fartash Faghri · PDF