Resume
Academic Achievements
- Characterizing the Expressivity of Fixed-Precision Transformer Language Models (2025, with Ryan Cotterell)
- Unique Hard Attention: A Tale of Two Sides (2025, with Selim Jerad et al.)
- What Do Language Models Learn in Context? The Structured Task Hypothesis (ACL 2024, with Yifan Hou, Mrinmaya Sachan, Ryan Cotterell)
- A Transformer with Stack Attention (NAACL Findings 2024, with Jennifer C. White et al.)
- Towards a Mechanistic Interpretation of Multi-Step Reasoning Capabilities of Language Models (EMNLP 2023, with Yifan Hou et al.)
- Probing via Prompting (NAACL 2022, with Ryan Cotterell, Mrinmaya Sachan)
- Differentiable Subset Pruning of Transformer Heads (TACL 2021, with Ryan Cotterell, Mrinmaya Sachan)
- Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models (EMNLP 2021, with Duygu Ataman, Rico Sennrich)