Updates

[Sept 2024] New paper On the Inductive Bias of Stacking Towards Improving Reasoning accepted at NeurIPS 2024

[May 2024] Our paper Can Looped Transformers Learn to Implement Multi-step Gradient Descent for In-context Learning? was accepted at ICML 2024

[Feb 2024] Paper on Efficient Stagewise Pretraining via Progressive Subnetworks with interns is out now!

[Aug 2023] Had the pleasure of hosting two summer interns at Google Research - Abhishek Panigrahi and Kaifeng Lyu

[May 2023] Reasoning in Large Language Models Through Symbolic Math Word Problems accepted at Findings of ACL 2023 and Natural Language Reasoning and Structured Explanations (NLRSE) workshop

[Apr 2023] Task-Specific Skill Localization in Fine-tuned Language Models accepted at ICML 2023!

[Apr 2023] Understanding Influence Functions and Datamodels via Harmonic Analysis presented at ICLR 2023

[Apr 2023] Selected as Notable Reviewer for ICLR 2023

[Jan 2023] Started as a Research Scientist at Google

[Jan 2023] Presented a talk on Towards Understanding Self-Supervised Learning at CMU

[July 2022] Defended my PhD thesis!