FROMANNUAL REVIEWS

CogSci 2025

•

July 31, 2025

•

San Francisco, United States

keywords:

semantics of language

concepts and categories

language comprehension

semantic memory

computational modeling

computer science

psychology

representation

knowledge representation

natural language processing

The longstanding question of how neural networks could implement relational composition has been buoyed by recent success showing relational abstraction in transformer-based large language models (LLMs). We address recent findings showing some, but imperfect, generalizability in linear composition during knowledge retrieval of attributive triplets Her- nandez, E. et al, (2024). Linearity of relation decoding in transformer language models arXiv:2308.09124). We report that limitations to relational generalization are explainable by two systematic factors. First, relational combinations that are more accurately retrieved generalize better than uncertain or inaccurate ones. Second, relational generalization scales with the semantic similarity of the entities being bound across triplets, showing that it is in fact non-linearly dependent on component meanings rather than being purely invariant. This aligns with longstanding findings that human judgments of adjectival combinations are likewise non-linearly interactive.

Downloads

Paper

Next from CogSci 2025

Happy Faces, Faster Stops: The Cognitive Benefits of Dance in Emotional Contexts
poster

Happy Faces, Faster Stops: The Cognitive Benefits of Dance in Emotional Contexts

CogSci 2025

Stuti Mehta and 1 other author

31 July 2025

Similar lecture

Modelling Complex Semantics Relation with Contrastively Fine-Tuned Relational Encoders
technical paper

Modelling Complex Semantics Relation with Contrastively Fine-Tuned Relational Encoders

ACL 2025

Zied Bouraoui
Naïm Es-sebbani and 2 other authors

28 July 2025

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Presentations
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2026 Underline - All rights reserved

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.