ICML 2026 Past Climate & sustainability

Continual Adaptation at Scale: Towards Sustainable AI Workshop

CATS@ICML26

Submission deadline
May 6, 2026, 12:00 UTC
imported from OpenReview — check the website for extensions
Submission portal
OpenReview
Notes
Auto-imported from the OpenReview venue record on 2026-06-10 — please verify and enrich (topics are keyword-guessed).

Accepted papers (47)

Fetched from OpenReview (v2) on 2026-06-10.

  1. A loss curvature account of fine-tuning fragility

    Ivaylo Dimitrov, Leo Karoubi, Sunny Howard, Dmitrii Krasheninnikov · PDF
  2. Aligning Language Models from User Interactions

    Thomas Kleine Buening, Jonas Hübotter, Barna Pásztor, Idan Shenfeld, Giorgia Ramponi, Andreas Krause · PDF
  3. Audit Before You Merge: Provenance, Probing, and Continual LoRA Composition

    Lenny Aharon, Neta Glazer, Lior Aharon · PDF
  4. AV-CTTA: Audio-Visual Continual Test-Time Adaptation without Forgetting

    Sarthak Kumar Maharana, Akshay Mehra, Bhavya Ramakrishna, Yunhui Guo, Guan-Ming Su · PDF
  5. Beyond Classification: Continual Learning for Multimodal Retrieval

    Alicja Dobrzeniecka, Filip Szatkowski, Sebastian Cygert, Szymon Lukasik, Bartłomiej Twardowski · PDF
  6. Calibrated Target-Aware Data Selection for Continual Mid-Training in Streams

    Ke Wan, Tianyi Zhao, Tianhao Huang, Guanghui Min, Chen Chen · PDF
  7. Can Large Language Models Keep Up? Benchmarking Online Adaptation to Continual Knowledge Streams

    Jiyeon Kim, Hyunji Lee, Dylan Zhou, Sue Hyun Park, Seunghyun Yoon, Trung Bui, Franck Dernoncourt, Sungmin Cha, Minjoon Seo · PDF
  8. Catastrophic Forgetting is Low-Rank: A Function-Space Theory for Continual Adaptation

    Ido Nitzan Hidekel, Dan Raviv · PDF
  9. Characterizing Plastic Regions in Neural Networks

    Gwyneth Liu, Nir N Shavit, Linghao Kong · PDF
  10. Continual Causal Refinement: Learning from Sequential Perturbation Data

    Masayuki Nagai, Alan Murphy, Peter K Koo · PDF
  11. Continual Knowledge Updating in LLM Systems: Learning Through Multi-Timescale Memory Dynamics

    Andreas Pattichis, Constantine Dovrolis · PDF
  12. Continual Learning of Physical Systems via Derivative Distillation

    Claudia Gentili, Alessandro Trenta, Andrea Cossu, Davide Bacciu · PDF
  13. DECAF: De-Clustering for Adaptive Representational Unlearning

    Anjie Le, Can Peng, Hongcheng Guo, J. Alison Noble · PDF
  14. Early Data Exposure Improves Robustness to Subsequent Fine-Tuning

    Lawrence Feng, Gaurav Rohit Ghosal, Jacob Mitchell Springer, Ziqian Zhong, Aditi Raghunathan · PDF
  15. Experience-Guided Behavior Adaptation for Large Language Models

    Iknoor Singh, Harjot Singh, Abhishek Tripathi, Niresh Agarwal, Murat Sensoy · PDF
  16. Externalizing Plasticity: Zero-Update Continual Learning via Symbolic Memories

    Manojshyaam C J · PDF
  17. Factor Imbalance and Plasticity Loss in Low-Rank Factorized Networks

    Seungwon Oh, KyungJoong Kim · PDF
  18. Fast-weight Product Key Memory

    Tianyu Zhao, Llion Jones · PDF
  19. Functional Task Networks: Cortex-Inspired Spatial Parameter Isolation for Continual Learning

    Kevin L McKee, Yicong Zheng, Zacharie Bugaud, Thomas Miconi · PDF
  20. Hard-First: Entropy-Guided Curriculum Distillation Balances Transfer and Preservation in Biomedical Vision-Language Models

    Junseob Kim, Sunil Hwang, Mehak Arora, Rishikesan Kamaleswaran · PDF
  21. Is Our Benchmark Enough? An Analysis of Continual Learning for MLLMs

    Van-Tuan Tran, Shruthi Gowda, Merim Dzaferagic, Marco Ruffini · PDF
  22. Listen, Look, and Learn: Learning Without Forgetting through SAM-Audio

    Avi Gupta, Nilotpal Sinha, Vishnu Raj, Sambuddha Saha, Pratik Joshi, Koteswar Rao Jerripothula, Tammam Tillo · PDF
  23. Machine Studying: A System-Level Reframing of Continual Adaptation from Declarative Corpora

    Xiaochen Li, Rick Battle, Omar Khattab · PDF
  24. Measurement Plasticity: Sensor-Level Adaptation for Vision–Language Models

    Boyeong Im, Wooseok Lee, Yoojin Kwon, Hyung-Sin Kim · PDF
  25. Mechanistic origins of catastrophic forgetting: why RL preserves circuits better than SFT?

    Jeanmely Rojas Nunez, Viraj Vilas Sawant, Nathan Allen, Nomgondalai Amgalanbaatar, Yannis Zongo, Kevin Zhu, Maheep Chaudhary · PDF
  26. MeMo: Memory as a Model

    Ryan Wei Heng Quek, Sanghyuk Lee, Alfred Wei Lun Leong, Arun Verma, Alok Prakash, Nancy F. Chen, Bryan Kian Hsiang Low, Daniela Rus, Armando Solar-Lezama · PDF
  27. Merging Adapted Models via Data-Free Covariance Estimation

    Marawan Gamal, Derek Tam, Pascal Junior Tikeng Notsawo, Colin Raffel, Guillaume Rabusseau · PDF
  28. Mitigating Catastrophic Forgetting in Continual RL via Certified Alignment

    Maksim Anisimov, Matthew Robert Wicker, Francesco Belardinelli · PDF
  29. On the Importance of Trivial Baselines: Re-evaluating LoRA Adapter Transfer for Generative Tasks

    Andreas Hochlehnert, Danni Liu, Jan Niehues, Shankar Kumar, Felix Stahlberg · PDF
  30. On-Policy Adaptation Mitigates Hyperparameter-Sensitive Forgetting in Vision-Language Models

    Doyoon Kim, Ziyang Wu, Jingfeng Yang, Yi Ma · PDF
  31. Organized Plasticity for Cost-Bounded Continual Adaptation

    You Rim Choi, Subeom Park, Reeahn Kim, Hyung-Sin Kim · PDF
  32. Orthogonal Mixture-of-Expert Low-Rank Adapter for Continual Learning

    Zhuoran Xie, Shichun Yang, Xu Mohan, Qingyun Ye, Jiong Ding, Chen rui, Fan Zhou · PDF
  33. Provable Forgetting Bounds Drive Capacity Savings: Spectral Thresholding in Continual LoRA

    Louis Barinka, Giulia Lanzillotta, Enis Simsar, Tanguy Dieudonné, Thomas Hofmann · PDF
  34. Quantifying Subliminal Behavioral Transfer Ratios in Language Model Distillation

    Uwe König, Hamza Kazmi, Ruizhe Li, Maheep Chaudhary · PDF
  35. REPO: Detoxifying LLMs via Representation Erasure-based Preference Optimization

    Nazanin Mohammadi Sepahvand, Eleni Triantafillou, Hugo Larochelle, Doina Precup, Daniel M. Roy, Gintare Karolina Dziugaite · PDF
  36. RepSelect: Robust LLM Unlearning via Representational Selectivity

    Filip Sondej, Yushi Yang, Adam Mahdi · PDF
  37. Rotation-Preserving Supervised Fine-Tuning

    Hangzhan Jin, Tianwei Ni, Lu Li, Pierre-Luc Bacon, Mohammad Hamdaqa, Doina Precup · PDF
  38. Route, Reuse, Repurpose: Continual Adaptation of LLMs with Bounded Adapter Pools

    Bilge Celik, Anna Vettoruzzo, Joaquin Vanschoren · PDF
  39. Selective Memory Retention for Long-Horizon LLM Agents

    Pranath Reddy · PDF
  40. Semantic Grouping with Dual-Strategy Distributional Rehearsal for Continual Learning

    Khoa Le Nho, Hồ Xuân Hùng, Thanh Hai Dang, Duc-Trong Le, Quynh-Trang Pham Thi · PDF
  41. SPA: A Simple but Tough-to-Beat Baseline for Knowledge Injection

    Kexian Tang, Jiani Wang, Shaowen Wang, Kaifeng Lyu · PDF
  42. Staged Continual Adaptation of Multimodal Foundation Models for Japanese Financial Documents

    Genshin Kakimoto, Atsushi Yanagisawa · PDF
  43. Subspace Optimization for Backpropagation-Free Continual Test-Time Adaptation

    Damian Sójka, Sebastian Cygert, Marc Masana · PDF
  44. Tell Me What To Learn: Generalizing Neural Memory to be Controllable in Natural Language

    Max S. Bennett, Thomas P Zollo, Richard Zemel · PDF
  45. Test-Time Training for Visual Foresight Vision-Language-Action Models

    Sangwu Park, Wonjoong Kim, Yeonjun In, Sein Kim, HongSeok Kang, Chanyoung Park · PDF
  46. The Geometry of Forgetting: A Fisher-Information Framework for Alignment-Preserving Continual Adaptation

    Soham Batra, Siddharth Karuturi, Kaustubh S. Bukkapatnam, Laksh Patel · PDF
  47. TIMEGATE: Sustainable Time-Boxed Promotion Gates for Continual ML Adaptation Under Resource Constraints

    Abhijit Chakraborty, Suddhasvatta Das, Yash Shah, Vivek Gupta, Kevin A. Gary · PDF