ICML 2024 Past Other

ICML 2024 Workshop on In-Context Learning

ICML 2024 Workshop ICL

Submission deadline
May 28, 2024, 12:00 UTC
imported from OpenReview — check the website for extensions
Submission portal
OpenReview
Notes
Auto-imported from the OpenReview venue record on 2026-06-10 — please verify and enrich (topics are keyword-guessed).

Accepted papers (39)

Fetched from OpenReview (v2) on 2026-06-10.

  1. A Theoretical Understanding of Self-Correction through In-context Alignment

    Yifei Wang, Yuyang Wu, Zeming Wei, Stefanie Jegelka, Yisen Wang · PDF
  2. An In-Context Learning Theoretic Analysis of Chain-of-Thought

    Chenxiao Yang, Zhiyuan Li, David Wipf · PDF
  3. Automatic Domain Adaptation by Transformers in In-Context Learning

    Ryuichiro Hataya, Kota Matsui, Masaaki Imaizumi · PDF
  4. Can large language models explore in-context?

    Akshay Krishnamurthy, Keegan Harris, Dylan J Foster, Cyril Zhang, Aleksandrs Slivkins · PDF
  5. Can LLMs predict the convergence of Stochastic Gradient Descent?

    Oussama Zekri, Abdelhakim Benechehab, Ievgen Redko · PDF
  6. Can Mamba In-Context Learn Task Mixtures?

    Yingcong Li, Xupeng Wei, Haonan Zhao, Taigao Ma · PDF
  7. Can Transformers Solve Least Squares to High Precision?

    Jerry Weihong Liu, Jessica Grogan, Owen M Dugan, Simran Arora, Atri Rudra, Christopher Re · PDF
  8. Cross-lingual QA: A Key to Unlocking In-context Cross-lingual Performance

    Sunkyoung Kim, Dayeon Ki, Yireun Kim, Jinsik Lee · PDF
  9. DETAIL: Task DEmonsTration Attribution for Interpretable In-context Learning

    Zijian Zhou, Xiaoqiang Lin, Xinyi Xu, Alok Prakash, Daniela Rus, Bryan Kian Hsiang Low · PDF
  10. Fast Training Dataset Attribution via In-Context Learning

    Milad fotouhi, Mohammad Taha Bahadori, Seyi Feyisetan, Payman Arabshahi, David Heckerman · PDF
  11. Fine-grained Analysis of In-context Linear Estimation: Data, Architecture, and Beyond

    Yingcong Li, Ankit Singh Rawat, Samet Oymak · PDF
  12. Improve Temporal Awareness of LLMs for Domain-general Sequential Recommendation

    Zhendong Chu, Zichao Wang, Ruiyi Zhang, Yangfeng Ji, Hongning Wang, Tong Sun · PDF
  13. In-Context Generalization to New Tasks From Unlabeled Observation Data

    Anthony Liang, Pavel Czempin, Yutai Zhou, Stephen Tu, Erdem Biyik · PDF
  14. In-Context Learning from Training on Unstructured Data: The Role of Co-Occurrence, Positional Information, and Training Data Structure

    Kevin Christian Wibisono, Yixin Wang · PDF
  15. In-context learning in presence of spurious correlations

    Hrayr Harutyunyan, Rafayel Darbinyan, Samvel Karapetyan, Hrant Khachatrian · PDF
  16. In-Context Learning of Energy Functions

    Rylan Schaeffer, Mikail Khona, Sanmi Koyejo · PDF
  17. In-Context Principle Learning from Mistakes

    Tianjun Zhang, Aman Madaan, Luyu Gao, Steven Zhang, Swaroop Mishra, Yiming Yang, Niket Tandon, Uri Alon · PDF
  18. In-Context Reinforcement Learning Without Optimal Action Labels

    Juncheng Dong, Moyang Guo, Ethan X Fang, Zhuoran Yang, Vahid Tarokh · PDF
  19. In-Context Symmetries: Self-Supervised Learning through Contextual World Models

    Sharut Gupta, Chenyu Wang, Yifei Wang, Tommi Jaakkola, Stefanie Jegelka · PDF
  20. Learning Fast and Slow: Representations for In-Context Weight Modulation

    Andrey Zhmoginov, Jihwan Lee, Max Vladymyrov, Mark Sandler · PDF
  21. Learning Task Representations from In-Context Learning

    Baturay Saglam, Zhuoran Yang, Dionysis Kalogerias, Amin Karbasi · PDF
  22. Linear Transformers are Versatile In-Context Learners

    Max Vladymyrov, Johannes von Oswald, Mark Sandler, Rong Ge · PDF
  23. LLM Processes: Numerical Predictive Distributions Conditioned on Natural Language

    James Requeima, John F Bronskill, Dami Choi, Richard E. Turner, David Duvenaud · PDF
  24. LLMs learn governing principles of dynamical systems, revealing an in-context neural scaling law

    Toni J.B. Liu, Nicolas Boulle, Raphaël Sarfati, Christopher Earls · PDF
  25. Localized Zeroth-Order Prompt Optimization

    Wenyang Hu, Yao Shu, Zongmin Yu, Zhaoxuan Wu, Xiaoqiang Lin, Zhongxiang Dai, See-Kiong Ng, Bryan Kian Hsiang Low · PDF
  26. Many-shot In-Context Learning

    Rishabh Agarwal, Avi Singh, Lei M Zhang, Bernd Bohnet, Luis Rosias, Stephanie C.Y. Chan, Biao Zhang, Aleksandra Faust, Hugo Larochelle · PDF
  27. Many-Shot In-Context Learning in Multimodal Foundation Models

    Yixing Jiang, Jeremy Andrew Irvin, Ji Hun Wang, Muhammad Ahmed Chaudhry, Jonathan H Chen, Andrew Y. Ng · PDF
  28. Polynomial Regression as a Task for Understanding In-context Learning Through Finetuning and Alignment

    Max Wilcoxson, Morten Svendgård, Ria Doshi, Dylan Davis, Reya Vir, Anant Sahai · PDF
  29. Probing the Decision Boundaries of In-context Learning in Large Language Models

    Siyan Zhao, Tung Nguyen, Aditya Grover · PDF
  30. Prompt Optimization with EASE? Efficient Ordering-aware Automated Selection of Exemplars

    Zhaoxuan Wu, Xiaoqiang Lin, Zhongxiang Dai, Wenyang Hu, Yao Shu, See-Kiong Ng, Patrick Jaillet, Bryan Kian Hsiang Low · PDF
  31. Retrieval & Fine-Tuning for In-Context Tabular Models

    Valentin Thomas, Junwei Ma, Rasa Hosseinzadeh, Keyvan Golestan, Guangwei Yu, Maksims Volkovs, Anthony L. Caterini · PDF
  32. TabMDA: Tabular Manifold Data Augmentation for Any Classifier using Transformers with In-context Subsetting

    Andrei Margeloiu, Adrián Bazaga, Nikola Simidjievski, Pietro Lio, Mateja Jamnik · PDF
  33. Task Descriptors Help Transformers Learn Linear Models In-Context

    Ruomin Huang, Rong Ge · PDF
  34. Transformers are Minimax Optimal Nonparametric In-Context Learners

    Juno Kim, Tai Nakamaki, Taiji Suzuki · PDF
  35. Transformers as Stochastic Optimizers

    Ryuichiro Hataya, Masaaki Imaizumi · PDF
  36. Transformers Can Perform Distributionally-robust Optimisation through In-context Learning

    Taeyoung Kim, Hongseok Yang · PDF
  37. Transformers Learn Temporal Difference Methods for In-Context Reinforcement Learning

    Jiuqi Wang, Ethan H Blaser, Hadi Daneshmand, Shangtong Zhang · PDF
  38. Universal Self-Consistency for Large Language Models

    Xinyun Chen, Renat Aksitov, Uri Alon, Jie Ren, Kefan Xiao, Pengcheng Yin, Sushant Prakash, Charles Sutton, Xuezhi Wang, Denny Zhou · PDF
  39. Verbalized Machine Learning: Revisiting Machine Learning with Language Models

    Tim Z. Xiao, Robert Bamler, Bernhard Schölkopf, Weiyang Liu · PDF