profile picture

Koustuv Sinha

FAIR, Meta

language models

natural language understanding

robustness

large language models

in-context learning

named entities

acceptability judgements

long context

2

presentations

SHORT BIO

Dr. Koustuv Sinha is a Research Scientist at Meta AI Research (Fundamental AI Research team). He did his PhD from McGill University and Mila Quebec AI Institute, supervised by Dr. Joelle Pineau. His research focuses on investigating systematicity and generalisation in natural language understanding (NLU) models, especially the state-of-the-art large language models, and develop methods to alleviate generalisation issues in production. He is the lead organizer of the annual ML Reproducibility Challenge, which has had six iterations since 2018 (2018-2022). He serves as a Journal Chair at NeurIPS 2022, and also an associate editor of ReScience, a journal promoting reproducibility reports in various fields of science. He has co-organized several workshops in the past, including NILLI (2021, 2022) at EMNLP, and ML Retrospectives at NeurIPS 2019.

Presentations

Robustness of Named-Entity Replacements for In-Context Learning

Dennis Minn and 8 other authors

Language model acceptability judgements are not always robust to context

Koustuv Sinha and 6 other authors

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Presentations
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2025 Underline - All rights reserved