Netherlands

Psychopathology, how we measure it and our conceptualization of its structure, is thought to be well reflected in natural language — an idea known as the Lexical Hypothesis. Recent advances in machine learning and artificial intelligence provide opportunities to explore this connection quantitatively. Using a Large Language Model, we extracted sentence embeddings for the items of three well validated measures of psychopathology measuring Externalizing (ESI), Internalizing (IDAS), and Personality Disorders (PID-5). We analyzed the semantic relationships between the items in these inventories in an attempt to predict patterns of association between self-report responses in a previously collected sample of participants responding to these measures. Our analysis revealed moderate correlations between the semantic relationships and item-pair response distributions for all three measures. Applying factor analysis to the semantic embeddings, we were able to extract the hierarchical structure of these measures: the inferred structures in some cases reflect similar ones based on psychometric analyses and also shed light on the ways that key dimensions of psychopathology are encoded differentially in modern language models. Our findings align well with the Lexical Hypothesis.

**Authors:**

Maria Martin Lopez: University of California, Berkeley; Keanan Joyner: University of California, Berkeley; Bill Thompson: University of California, Berkeley

CogSci 2024

Natural Language Semantics Encode Key Dimensions of Psychopathology

poster

The 46th Annual Meeting of the Cognitive Science Society was an in-person meeting held in Rotterdam, The Netherlands at the Postillion Hotel & Conference Centre.

**ON-DEMAND PROGRAM ACCESS AFTER THE CONFERENCE** 
Recordings of the invited program are now available. You can access them by clicking on the 'Schedule' icon on the left. Select view by week and navigate to the day and time slot of the recording you wish to view. Click on the time slot to access the recording.

Recordings available (click on each recording to view):

**Thursday, July 25** 
0900: [Keynote Speaker Morgan Barense on Enhancing real-world event memory](https://underline.io/events/465/sessions/17997/lecture/99084-dynamics-between-minds-and-the-environment) 
1000: [Gleitman Award Winner Isabelle Dautriche on Language Foundations: Insights from acquisition, communication, cognition, and more](https://underline.io/events/465/sessions/18000/lecture/99085-gleitman-talk) 
1415: [Invited Symposium: Dynamics between minds and the environment](https://underline.io/events/465/sessions?eventSessionId=18016&searchGroup=lecture) 
1700: [Rumelhart Prize Presentation Speaker Alison Gopnik on Exploit, explore, empower: Three ages and three intelligences](https://underline.io/events/465/sessions/18028/lecture/99161-rp1-rumelhart-prize-presentation) 

**Friday, July 26** 
0900: [C.L. de Carvalho-Heineken Prize Keynote Speaker Kia Nobre on Focusing in memory](https://underline.io/events/465/sessions/18035/lecture/99162-hp1-c-l-de-carvalho-heineken-prize-keynote-address) 
1030: [Rumelhart Symposium: Childhood as exploration](https://underline.io/events/465/sessions/18038/lecture/100346-childhood-as-exploration) 
1415: [Elman Prize Symposium](https://underline.io/events/465/sessions?eventSessionId=18053&searchGroup=lecture) 
1600: [Invited Symposium: Dynamics between minds](https://underline.io/events/465/sessions?eventSessionId=18065&searchGroup=lecture) 
1745: [Keynote Speaker Andrea E. Martin on Neural dynamics encode the structure and statistics of language](https://underline.io/events/465/sessions/18077/lecture/99271-neural-dynamics-encode-the-structure-and-statistics-of-language) 

**Saturday, July 27** 
0900: [Keynote Speaker Gregor Schöner on How higher cognition emerges from the dynamics of strongly interacting neural populations](https://underline.io/events/465/sessions/18083/lecture/99273-dynamics-within-the-mind) 
1000: [Glushko Talks](https://underline.io/events/465/sessions?eventSessionId=18086&searchGroup=lecture) 
1500: [Invited Symposium: Dynamics within minds](https://underline.io/events/465/sessions?eventSessionId=18100&searchGroup=lecture) 


#### **CogSci 2024 Program Book**
<div style="position:relative;padding-top:0;width:900px;height:500px;"><iframe style="position:absolute;border:none;width:100%;height:100%;left:0;top:0;" src="https://online.fliphtml5.com/ebtyf/cble/" seamless="seamless" scrolling="no" frameborder="0" allowtransparency="true" allowfullscreen="true" ></iframe></div>


**The Program Book can be downloaded [here](https://drive.google.com/file/d/1yRVp1cBqRnAbdYi4GXWV_pZeyWNsRquv/view?usp=sharing).**

#### **Letter from the President**

Welcome to the 2024 Meeting of the Cognitive Science Society in Rotterdam! CogSci 2024 brings together a large community of cognitive scientists who have traveled here from around the world, as well as a smaller group of remote presenters. I would like to extend an especially warm welcome to our first-time CogSci meeting attendees, and hope that 
their experience inspires them to join our future meetings for many years to come.

I want to thank this year’s conference co-chairs, Larissa K Samuelson, Stefan Frank, Mariya Toneva, Allyson Mackey, and Eliot Hazeltine, for putting together an amazing series of invited talks and symposia around the theme of Dynamics of Cognition. The co-chairs also deserve credit for handling a record-breaking number of submissions and producing a truly exciting conference program 

Beyond the invited talks and symposia dedicated to this year’s conference theme, I would like to highlight the presentations and events honoring the 
Rumelhart, Elman, Gleitman and C .L . de Carvalho Heineken prize winners, including the Rumelhart reception on Thursday. As you may know, we are recording all of the invited talks and symposia, and all prize-winners’ talks, and will be making this content available after the conference. 

The Cognitive Science Society relies on the volunteer efforts of our Governing Board members who work on matters related to our membership; conference policies; diversity and inclusion, international, and outreach initiatives; prizes and much more. We welcome interest from Society members who would like to become more involved in what we do. The 
Society is deeply grateful to Rick Dale and Andrea Bender, who serve as editors of the two Society journals, Cognitive Science and Topics in Cognitive Science respectively. We especially acknowledge our editors’ generosity in donating their stipends each year to D&I and outreach efforts. 

This year’s Annual Meeting depends critically on the support of Marischal De Armond and his team at Podium Conference Specialists: Sharon Zwack, Cendrine De Vis, Sarah-Kate Burke, and Rachel Waller worked tirelessly to secure the venue and handled a multitude of logistical and organizational issues, from arranging coffee breaks and receptions to making sure that a huge number of posters fits comfortably into the available space. Finally, and importantly, I would like to acknowledge the Cognitive Science Society Executive Officer, Erica Wojcik, for managing the complex and ever expanding sphere of our Society’s activities.

I hope you enjoy this year’s meeting and the many different opportunities to engage with the vibrant community of cognitive scientists gathered here. I also hope you get a chance to explore the great city of Rotterdam with its many attractions, museums, restaurants and scenic views. If you’d like to talk more about our Society, or simply want to say hello, please stop by!

![](https://assets.underline.io/markdown_image/1/image/3c66d0e21fff30e204df1138ffd15173.jpeg)

**Anna Papafragou** 
President, Cognitive Science 
Society 2023-2024

**CODE OF CONDUCT** 
By attending the CogSci 2024 Conference, you are required to adhere to the society’s [Code of Conduct](https://drive.google.com/file/d/16-6KkptF0Gn3ZYGJDlpqpwTdImw45Ng0/view?usp=drive_link).

**ABOUT THE COGNITIVE SCIENCE SOCIETY** 
The Cognitive Science Society brings together researchers from around the world who hold a common goal: understanding the nature of the human mind. The mission of the Society is to promote Cognitive Science as a discipline, and to foster scientific interchange among researchers in various areas of study, including Artificial Intelligence, Linguistics, Anthropology, Psychology, Neuroscience, Philosophy, and Education.

The Society is a non-profit professional organization and its activities include sponsoring an annual conference and publishing the journals Cognitive Science and TopiCS.

You need to log in with the email address you registered with. Access credentials have been sent to your email. 

Please be sure to check your spam and other email folders if you do not see an email confirmation right away.

Please log in to explore this event.

It looks like you are not registered for this event. 

To access the site please register [**here**](https://cognitivesciencesociety.org/registration/). 

Please register!

The 46th Annual Meeting of the Cognitive Science Society presents the latest research across cognitive science and highlights the theme of Cognition in Context.

Vector embedding spaces are representational structures that can capture both the similarity relationship between items and various other semantic relationships. Current state-of-the-art embedding models can generate embedding vectors for individual words and longer strings of text, enabling the vector space to encode the similarity between entire documents of text. We explored whether semantic relationships besides similarity are represented in this space, focusing on the relationship between arguments and counterarguments as a specific example. While there was not a linear subspace that captured the semantic relationship between an argument and its counterargument, we found that a neural network with a single hidden layer could partially learn the transformation between an argument's embedding vector and the corresponding counterargument's embedding vector. This trained model generalized across three different datasets of arguments, suggesting that the partially learned transformation is applicable to arguments and counterarguments in general, not just tied to the semantic context of the model’s training dataset. This approach has practical applications in designing information retrieval systems for intelligent agents and, potentially, in models of cognition that use vector embedding spaces as a representational structure.

**Authors:**

Cherrie Chang: Vassar College; Josh de Leeuw: Vassar College

Searching for Argument-Counterargument Relationships in Vector Embeddings

An accurate estimation of driver vigilance is crucial for reducing fatigue-related incidents and traffic accidents. Despite advances in the field of fatigue detection, effective utilization of multimodal information remains a major challenge. Additionally, prevalent methodologies predominantly focus on local features, overlooking the importance of global features in this context. To solve the above problems, we propose the deep channel attention transformer (DCAT) model, which can effectively utilize multimodal information and extract local-global features for fatigue detection regression tasks. We first introduce a novel multimodal approach that integrates electroencephalography (EEG) and electrooculogram (EOG) data, capitalizing on their complementary strengths to enhance the understanding and assessment of fatigue states. Then, the DCAT model utilizes multimodal information by extracting local and global features using channel attention and transformer encoder modules, respectively. Our evaluation of the SEED-VIG and SADT public datasets showcases the model's superior performance compared to that of the state-of-the-art baselines.

**Authors:**

Jiahui Pan: South China Normal University; Dehua Lu: South China Normal University

A Deep Channel Attention Transformer for Multimodal EEG-EOG-Based Vigilance Estimation

I formalize the problem of care in the mathematical language of sequential decision-making. Drawing upon insights from developmental psychology, robotics, and computational cognitive modeling, I conceptualize care as a dynamic interplay between the caregiver ('one-caring') and the care recipient ('cared-for'). Caring actions maximize the utility of the cared-for at a future point when they are required to act autonomously. Since this quantity cannot be directly optimized, the focus is on enabling increasing levels of autonomy through environmental shaping, risk reduction, and safe exploration. I distinguish caregiving from helping and teaching by care’s focus on exploration and autonomy that increase capacity over time. In the context of elderly care, the emphasis shifts towards preserving rather than enhancing capacity. Finally, I consider the role of caregiving in the development of moral values and the possibility of artificially intelligent agents that might someday care for us.

**Authors:**

Max Kleiman-Weiner: University of Washington

Computational Principles of Caregiving

Here we present a new Explainable AI (XAI) method to probe the functional partition in AI models by comparing features attended to at different layers with human attention driven by diverse task demands. We applied this method to explain an object detector Yolo-v5s in multi-category and single-category object detection tasks. We found that the model’s neck showed higher similarity to human attention during object detection, indicating a reliance on diagnostic features in the neck, whereas its backbone showed higher similarity to attention during passive viewing, indicating salient local features encoded. With this understanding of its functional partition, using Yolo-v5s as a model for human cognition, our comparative analysis against human attention when providing explanations for object detection revealed that humans attended to a combination of diagnostic and salient features during explaining multi-category general object detection but attended to mainly diagnostic features when explaining single-category human/vehicle detection in driving scenarios.

**Authors:**

Jinhan Zhang: The University of Hong Kong; Guoyang Liu: Shandong University; Yunke Chen: The University of Hong Kong; Antoni B. Chan: City University of Hong Kong; Janet Hsiao: Hong Kong University of Science & Technology

Demystify Deep-learning AI for Object Detection using Human Attention Data

Computational models of syntax are predominantly text-based. Here we propose that basic syntax can be modeled directly from raw speech in a fully unsupervised way. We focus on one of the most ubiquitous and elementary properties of syntax--concatenation. We introduce spontaneous concatenation: a phenomenon where convolutional neural networks (CNNs) trained on acoustic recordings of individual words start generating outputs with two or even three words concatenated without ever accessing data with multiple words in the input. Additionally, networks trained on two words learn to embed words into novel unobserved word combinations. To our knowledge, this is a previously unreported property of CNNs trained on raw speech in the Generative Adversarial Network setting and has implications both for our understanding of how these architectures learn as well as for modeling syntax and its evolution from raw acoustic inputs.

**Authors:**

Gasper Begus: University of California, Berkeley; Thomas Lu: University of California Berkeley; Zili Wang: Iowa State University

Basic syntax from speech: Spontaneous concatenation in unsupervised deep neural networks

The mental lexicon is a well-known theoretical construct in psycholinguistic research but is relatively unexplored in large language models (LLMs). We prompted lexicon functions in ChatGPT and compared numeric responses to a sample of 390 words for a range of lexical variables, some derived from corpus analyses and some from human ratings. Responses for were correlated with corpus measures and human ratings, more so for GPT-4 versus GPT-3.5, and for some variables compared with others. This variability indicates that functions are not recalled from memorized training data but are instead soft-assembled from general-purpose representations. Further analyses showed that GPT-4 functions were sensitive to subtle changes in word list composition, and they more closely matched human ratings for variables and words with higher inter-rater reliability. LLMs offer a mental lexicon in which functions emerge through a process of soft-assembly directed by task demands and shaped by context.

**Authors:**

Christopher Kello: University of California Merced; Polyphony J Bruna: University of California Merced

Emergent Mental Lexicon Functions in ChatGPT

Cobweb, a human-like category learning system, differs from other incremental categorization models in constructing hierarchically organized cognitive tree-like structures using the category utility measure. Prior studies have shown that Cobweb can capture psychological effects such as the basic-level, typicality, and fan effects. However, a broader evaluation of Cobweb as a model of human categorization remains lacking. The current study addresses this gap. It demonstrates Cobweb's alignment with classical human category learning effects. It also explores Cobweb's flexibility to exhibit both exemplar- and prototype-like learning within a single model. These findings set the stage for future research on Cobweb as a comprehensive model of human category learning.

**Authors:**

Xin Lian: Georgia Institute of Technology; Sashank Varma: Georgia Tech; Christopher MacLellan: Georgia Institute of Technology

Cobweb: An Incremental and Hierarchical Model of Human-Like Category Learning

People frequently encounter the challenge of deciding when to cease exploring options to optimize outcomes, such as when selecting an apartment in a fluctuating housing market or booking a dinner reservation on New Year’s Eve. Despite experiencing these decisions on multiple occasions, people often struggle to stop searching optimally. This research investigates human learning abilities in optimal stopping tasks, focusing on feedback and knowledge of option value distributions. Through an experimental sequential choice task, we demonstrate that experience enhances optimal stopping, with feedback significantly influencing learning. Furthermore, awareness of the value distribution reduces exploration and the duration of the search. A cognitive model accurately predicts these effects, shedding light on human learning processes.

**Authors:**

Erin H. Bugbee: Carnegie Mellon University; Cleotilde Gonzalez: Carnegie Mellon University

Feedback Promotes Learning and Knowledge of the Distribution of Values Hinders Exploration in an Optimal Stopping Task

Object Permanence (OP) is the understanding that objects continue to exist when not directly observable. To date, this ability has proven difficult to build into AI systems, with Deep Reinforcement Learning (DRL) systems performing significantly worse than human children. Here, DRL Agents, PPO and Dreamer-v3 were tested against a number of comparators (Human children, random agents and hard coded Heuristic agents) on 3 object permanence tasks (OP) and a range of control tasks. As expected, the children performed well across all tasks, while performance of the DRL agents was mixed. Overall the pattern of performance across OP and control tasks did not suggest that any agent tested except children showed evidence of robust OP.

**Authors:**

Konstantinos Voudouris: University of Cambridge; Jason Darwin Liu: University of Cambridge; Natasza Siwinska: University of Cambridge; Wout Schellaert: Universitat Politècnica de València; Lucy G Cheke: University of Cambridge

Investigating Object Permanence in Deep Reinforcement Learning Agents

Although we are generally good at observing a busy scene and determining whether it contains one agent pursuing another, we are not immune to making errors and may identify a pursuit when there is none. Further, we may have difficulty articulating exactly what information allowed us to determine whether there was a pursuit. To gain a better measure of when people correctly or erroneously detect pursuit, we designed a novel pursuit detection task. To compare performance given different strategies, we developed a cognitive model that can perform this task. The results of our pursuit detection experiment indicate that, indeed, people typically identify pursuit events correctly, but they make infrequent yet systematic errors for particular scenes. When the model implements specific strategies, simulation results are well correlated with empirical results. Moreover, the model makes the same errors as human participants. We show how the empirical results can be accounted for in terms of decision criteria indicated by high performing model strategies.

**Authors:**

Maria Kon: U.S. Naval Research Laboratory; Sangeet Khemlani: U.S. Naval Research Laboratory; Andrew Lovett: U.S. Naval Research Laboratory

Premium content

Downloads

Next from CogSci 2024

Searching for Argument-Counterargument Relationships in Vector Embeddings

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES