
Koustuv Sinha
FAIR, Meta
language models
natural language understanding
robustness
large language models
in-context learning
named entities
acceptability judgements
long context
2
presentations
SHORT BIO
Dr. Koustuv Sinha is a Research Scientist at Meta AI Research (Fundamental AI Research team). He did his PhD from McGill University and Mila Quebec AI Institute, supervised by Dr. Joelle Pineau. His research focuses on investigating systematicity and generalisation in natural language understanding (NLU) models, especially the state-of-the-art large language models, and develop methods to alleviate generalisation issues in production. He is the lead organizer of the annual ML Reproducibility Challenge, which has had six iterations since 2018 (2018-2022). He serves as a Journal Chair at NeurIPS 2022, and also an associate editor of ReScience, a journal promoting reproducibility reports in various fields of science. He has co-organized several workshops in the past, including NILLI (2021, 2022) at EMNLP, and ML Retrospectives at NeurIPS 2019.
Presentations

Robustness of Named-Entity Replacements for In-Context Learning
Dennis Minn and 8 other authors

Language model acceptability judgements are not always robust to context
Koustuv Sinha and 6 other authors