Posts
-
Mechanistic Investigations of In-Context Learning
Large language models exhibit this capability. The question is: how? Studying ICL systematically in large frontier models is very difficult. In order to make progress, I conduct a mechanistic analysis of ICL in the simplified ICL linear regression setting introduced by Garg et al. (2022).