FROMANNUAL REVIEWS

CogSci 2025

•

July 31, 2025

•

San Francisco, United States

keywords:

language production

artificial intelligence

linguistics

discourse

pragmatics

Instruction tuning (IT) has been a fruitful technique for aligning Large Language Models with human preferences. However, the linguistic implications of IT remain unclear. In two experiments on coreference and coherence biases in the context of Implicit Causality, we investigate how IT modulates these discourse biases in relation to model size. Our results show that IT interacts with model size -- instruction-tuned models display enhanced coherence biases and more human-like coreference patterns, sometimes exceeding human performance. However, this effect appears size-dependent, suggesting that IT causes some linguistic patterns to emerge that are dormant in the respective foundation models.

Downloads

Paper

Next from CogSci 2025

Using Head-Mounted Eye Tracking to Examine Infant Face Looking During Naturalistic Freeplay
poster

Using Head-Mounted Eye Tracking to Examine Infant Face Looking During Naturalistic Freeplay

CogSci 2025

Brianna Kaplan and 2 other authors

31 July 2025

Similar lecture

Discourse Relation-Enhanced Neural Coherence Modeling
poster

Discourse Relation-Enhanced Neural Coherence Modeling

ACL 2025

Michael Strube
Wei Liu and 1 other author

30 July 2025

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Presentations
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2026 Underline - All rights reserved

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.