ICLR 2025 Past Other

ICLR 2025 Workshop on Modularity for Collaborative, Decentralized, and Continual Deep Learning

MCDC @ ICLR 2025

Submission deadline
Feb 13, 2025, 11:59 UTC
imported from OpenReview — check the website for extensions
Submission portal
OpenReview
Notes
Auto-imported from the OpenReview venue record on 2026-06-10 — please verify and enrich (topics are keyword-guessed).

Accepted papers (35)

Fetched from OpenReview (v2) on 2026-06-10.

  1. A Framework for Double-Blind Federated Adaptation of Foundation Models

    Nurbek Tastan, Karthik Nandakumar · PDF
  2. Adaptive Local Training in Federated Learning

    Donald Shenaj, Eugene Belilovsky, Pietro Zanuttigh · PDF
  3. An Empirical Study of Policy Interpolation via Diffusion Models

    Yuqing Xie, Chao Yu, Ya Zhang, Yu Wang · PDF
  4. Beyond Top-K: Structured Sparsification for Compression in Pipeline Parallel

    Sameera Ramasinghe, Thalaiyasingam Ajanthan, Gil Avraham, Yan Zuo, Alexander Long · PDF
  5. BICEC: Attachable Classification-Based Intelligent Control for Sustainable Computer Vision Systems

    Jonathan Burton-Barr, Deepu Rajan, Basura Fernando · PDF
  6. CAMEx: Curvature-aware Merging of Experts

    Dung Viet Nguyen, Minh Hoang Nguyen, Luc Nguyen, Rachel S.Y. Teo, Tan Minh Nguyen, Linh Duy Tran · PDF
  7. Collective Model Intelligence Requires Compatible Specialization

    Jyothish Pari, Samy Jelassi, Pulkit Agrawal · PDF
  8. ComfyGen: Prompt-Adaptive Workflows for Text-to-Image Generation

    Rinon Gal, Adi Haviv, Yuval Alaluf, Amit Haim Bermano, Daniel Cohen-Or, Gal Chechik · PDF
  9. Conditioning on Local Statistics for Scalable Heterogeneous Federated Learning (Tiny Paper)

    Rickard Brannvall · PDF
  10. Disentangling Sequence Memorization and General Capability in Large Language Models

    Gaurav Rohit Ghosal, Pratyush Maini, Aditi Raghunathan · PDF
  11. Efficient Distributed Optimization under Heavy-Tailed Noise

    Su Hyeong Lee, Manzil Zaheer, Tian Li · PDF
  12. Exact Unlearning of Finetuning Data via Model Merging at Scale

    Kevin Kuo, Amrith Setlur, Kartik Srinivas, Aditi Raghunathan, Virginia Smith · PDF
  13. Exploring Asynchronism in SWARM Parallelism

    Yan Zuo, Gil Avraham, Thalaiyasingam Ajanthan, Sameera Ramasinghe, Alexander Long · PDF
  14. Exploring Sparse Adapters for Scalable Merging of Parameter Efficient Experts

    Samin Yeasar Arnob, Zhan Su, Minseon Kim, Oleksiy Ostapenko, Doina Precup, Lucas Caccia, Alessandro Sordoni · PDF
  15. Federated Circuits: A Unified Framework for Scalable and Efficient Federated Learning

    Jonas Seng, Florian Peter Busch, Pooja Prasad, Devendra Singh Dhami, Martin Mundt, Kristian Kersting · PDF
  16. FedMoDN: Federated Modular Decision Support Networks

    Cécile Trottet, Michael Krauthammer, Mary-Anne Hartley · PDF
  17. HDEE: Heterogeneous Domain Expert Ensemble

    Oguzhan Ersoy, Jari Kolehmainen, Gabriel Passamani Andrade · PDF
  18. Hierarchical Subspaces of Policies for Continual Offline Reinforcement Learning

    Anthony Kobanda, Rémy Portelas, Odalric-Ambrym Maillard, Ludovic Denoyer · PDF
  19. How to Merge Multimodal Models Over Time?

    Sebastian Dziadzio, Vishaal Udandarao, Karsten Roth, Ameya Prabhu, Zeynep Akata, Samuel Albanie, Matthias Bethge · PDF
  20. Improving the Efficiency of Distributed Training using Sparse Parameter Averaging

    Matt Beton, Matthew Reed, Seth Howes, Alex Cheema, Mohamed Baioumy · PDF
  21. Mastering Massive Multi-Task Reinforcement Learning via Mixture-of-Expert Decision Transformer

    Yilun Kong, Guozheng Ma, Qi Zhao, Haoyu Wang, Li Shen, Xueqian Wang, Dacheng Tao · PDF
  22. Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models

    Weixin Liang, LILI YU, Liang Luo, Srini Iyer, Ning Dong, Chunting Zhou, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer, Xi Victoria Lin · PDF
  23. MoLEx: Mixture of Layer Experts for Finetuning with Sparse Upcycling

    Rachel S.Y. Teo, Tan Minh Nguyen · PDF
  24. Momentum Look-Ahead for Asynchronous Distributed Low-Communication Training

    Thalaiyasingam Ajanthan, Sameera Ramasinghe, Gil Avraham, Yan Zuo, Alexander Long · PDF
  25. Multi-Agent Verification: Scaling Test-Time Compute with Multiple Verifiers (Abridged)

    Shalev Lifshitz, Sheila A. McIlraith, Yilun Du · PDF
  26. NoEsis: A Modular LLM with Differentially Private Knowledge Transfer

    Rob Romijnders, Stefanos Laskaridis, Ali Shahin Shamsabadi, Hamed Haddadi · PDF
  27. On-Device Collaborative Language Modeling via a Mixture of Generalists and Specialists

    Dongyang Fan, Bettina Messmer, Nikita Doikov, Martin Jaggi · PDF
  28. ReMod: Learning Structured Sparsity with ReLU Modulation

    Wenbo Zhang, Xiang Ren · PDF
  29. Rethinking Decentralized Learning: Towards More Realistic Evaluations with a Metadata-Agnostic Approach

    Tianyu Zhang, Lu Li, Tongtian Zhu, Suyuchen Wang, Can Wang, Yong Chen · PDF
  30. Revisiting Sparse Mixture of Experts for Resource-adaptive Federated Fine-tuning Foundation Models

    Van-Tuan Tran, Le Huy Khiem, Quoc-Viet Pham · PDF
  31. ROBUST ONLINE INFERENCE USING ADAPTIVE MODEL SWITCHING

    Kalpan Mukherjee, Vikramank Singh, Abishek Sankararaman, Balakrishnan Murali Narayanaswamy, Tim Kraska · PDF
  32. Soup-of-Experts: Pretraining Specialist Models via Parameters Averaging

    Pierre Ablin, Angelos Katharopoulos, Skyler Seto, David Grangier · PDF
  33. Tight Clusters Make Specialized Experts

    Stefan Nielsen, Rachel S.Y. Teo, Laziz Abdullaev, Tan Minh Nguyen · PDF
  34. Training Plug n' Play Knowledge Modules with Deep Context Distillation

    Lucas Caccia, Alan Ansell, Ivan Vulić, Edoardo Ponti, Alessandro Sordoni · PDF
  35. Truncate without Fear: Module Aggregation and Redistribution in Federated Low-Rank Adaptation

    Zhijie Chen, Yuxing Liu, Arindam Banerjee · PDF