Netherlands

This research explores the potential of machine learning (ML) in identifying vocal markers for schizophrenia. While previous research showed that voice-based ML models can accurately predict schizophrenia diagnosis and symptoms, it is unclear to what extent such ML markers generalize to different clinical subpopulations and languages: the assessment of generalization performance is however crucial for testing their clinical applicability.
We systematically examined voice-based ML model performance on a large cross-linguistic dataset (3 languages: Danish, German, Chinese). Employing a rigorous pipeline to minimize overfitting, including cross-validated training sets and multilingual models, we assessed generalization on participants with schizophrenia and controls speaking the same or different languages. Model performance was comparable to state-of-the art findings (F1-score ~ 0.75) within the same language; however, models did not generalize well - showing a substantial decrease - when tested on new languages, and the performance of multilingual models was also generally low (F1-score ~ 0.50).

**Authors:**

Alberto Parola: Copenhagen University; Astrid Rybner: Aarhus University; Emil Trenckner Jessen: Aarhus University; Stine Nyhus Larsen: Aarhus University; Marie Damsgaard Mortensen: Aarhus University; Arndis Simonsen: Aarhus University; Yuan Zhou: Chinese Academy of Sciences; Katja Koelkebeck: Hospital and Institute of the University of Duisburg-Essen; Vibeke Bliksted: Aarhus University; Riccardo Fusaroli: Aarhus University

CogSci 2024

Voice markers of schizophrenia: assessing the generalizability of machine learning models and their clinical applicability

The 46th Annual Meeting of the Cognitive Science Society was an in-person meeting held in Rotterdam, The Netherlands at the Postillion Hotel & Conference Centre.

**ON-DEMAND PROGRAM ACCESS AFTER THE CONFERENCE** 
Recordings of the invited program are now available. You can access them by clicking on the 'Schedule' icon on the left. Select view by week and navigate to the day and time slot of the recording you wish to view. Click on the time slot to access the recording.

Recordings available (click on each recording to view):

**Thursday, July 25** 
0900: [Keynote Speaker Morgan Barense on Enhancing real-world event memory](https://underline.io/events/465/sessions/17997/lecture/99084-dynamics-between-minds-and-the-environment) 
1000: [Gleitman Award Winner Isabelle Dautriche on Language Foundations: Insights from acquisition, communication, cognition, and more](https://underline.io/events/465/sessions/18000/lecture/99085-gleitman-talk) 
1415: [Invited Symposium: Dynamics between minds and the environment](https://underline.io/events/465/sessions?eventSessionId=18016&searchGroup=lecture) 
1700: [Rumelhart Prize Presentation Speaker Alison Gopnik on Exploit, explore, empower: Three ages and three intelligences](https://underline.io/events/465/sessions/18028/lecture/99161-rp1-rumelhart-prize-presentation) 

**Friday, July 26** 
0900: [C.L. de Carvalho-Heineken Prize Keynote Speaker Kia Nobre on Focusing in memory](https://underline.io/events/465/sessions/18035/lecture/99162-hp1-c-l-de-carvalho-heineken-prize-keynote-address) 
1030: [Rumelhart Symposium: Childhood as exploration](https://underline.io/events/465/sessions/18038/lecture/100346-childhood-as-exploration) 
1415: [Elman Prize Symposium](https://underline.io/events/465/sessions?eventSessionId=18053&searchGroup=lecture) 
1600: [Invited Symposium: Dynamics between minds](https://underline.io/events/465/sessions?eventSessionId=18065&searchGroup=lecture) 
1745: [Keynote Speaker Andrea E. Martin on Neural dynamics encode the structure and statistics of language](https://underline.io/events/465/sessions/18077/lecture/99271-neural-dynamics-encode-the-structure-and-statistics-of-language) 

**Saturday, July 27** 
0900: [Keynote Speaker Gregor Schöner on How higher cognition emerges from the dynamics of strongly interacting neural populations](https://underline.io/events/465/sessions/18083/lecture/99273-dynamics-within-the-mind) 
1000: [Glushko Talks](https://underline.io/events/465/sessions?eventSessionId=18086&searchGroup=lecture) 
1500: [Invited Symposium: Dynamics within minds](https://underline.io/events/465/sessions?eventSessionId=18100&searchGroup=lecture) 


#### **CogSci 2024 Program Book**
<div style="position:relative;padding-top:0;width:900px;height:500px;"><iframe style="position:absolute;border:none;width:100%;height:100%;left:0;top:0;" src="https://online.fliphtml5.com/ebtyf/cble/" seamless="seamless" scrolling="no" frameborder="0" allowtransparency="true" allowfullscreen="true" ></iframe></div>


**The Program Book can be downloaded [here](https://drive.google.com/file/d/1yRVp1cBqRnAbdYi4GXWV_pZeyWNsRquv/view?usp=sharing).**

#### **Letter from the President**

Welcome to the 2024 Meeting of the Cognitive Science Society in Rotterdam! CogSci 2024 brings together a large community of cognitive scientists who have traveled here from around the world, as well as a smaller group of remote presenters. I would like to extend an especially warm welcome to our first-time CogSci meeting attendees, and hope that 
their experience inspires them to join our future meetings for many years to come.

I want to thank this year’s conference co-chairs, Larissa K Samuelson, Stefan Frank, Mariya Toneva, Allyson Mackey, and Eliot Hazeltine, for putting together an amazing series of invited talks and symposia around the theme of Dynamics of Cognition. The co-chairs also deserve credit for handling a record-breaking number of submissions and producing a truly exciting conference program 

Beyond the invited talks and symposia dedicated to this year’s conference theme, I would like to highlight the presentations and events honoring the 
Rumelhart, Elman, Gleitman and C .L . de Carvalho Heineken prize winners, including the Rumelhart reception on Thursday. As you may know, we are recording all of the invited talks and symposia, and all prize-winners’ talks, and will be making this content available after the conference. 

The Cognitive Science Society relies on the volunteer efforts of our Governing Board members who work on matters related to our membership; conference policies; diversity and inclusion, international, and outreach initiatives; prizes and much more. We welcome interest from Society members who would like to become more involved in what we do. The 
Society is deeply grateful to Rick Dale and Andrea Bender, who serve as editors of the two Society journals, Cognitive Science and Topics in Cognitive Science respectively. We especially acknowledge our editors’ generosity in donating their stipends each year to D&I and outreach efforts. 

This year’s Annual Meeting depends critically on the support of Marischal De Armond and his team at Podium Conference Specialists: Sharon Zwack, Cendrine De Vis, Sarah-Kate Burke, and Rachel Waller worked tirelessly to secure the venue and handled a multitude of logistical and organizational issues, from arranging coffee breaks and receptions to making sure that a huge number of posters fits comfortably into the available space. Finally, and importantly, I would like to acknowledge the Cognitive Science Society Executive Officer, Erica Wojcik, for managing the complex and ever expanding sphere of our Society’s activities.

I hope you enjoy this year’s meeting and the many different opportunities to engage with the vibrant community of cognitive scientists gathered here. I also hope you get a chance to explore the great city of Rotterdam with its many attractions, museums, restaurants and scenic views. If you’d like to talk more about our Society, or simply want to say hello, please stop by!

![](https://assets.underline.io/markdown_image/1/image/3c66d0e21fff30e204df1138ffd15173.jpeg)

**Anna Papafragou** 
President, Cognitive Science 
Society 2023-2024

**CODE OF CONDUCT** 
By attending the CogSci 2024 Conference, you are required to adhere to the society’s [Code of Conduct](https://drive.google.com/file/d/16-6KkptF0Gn3ZYGJDlpqpwTdImw45Ng0/view?usp=drive_link).

**ABOUT THE COGNITIVE SCIENCE SOCIETY** 
The Cognitive Science Society brings together researchers from around the world who hold a common goal: understanding the nature of the human mind. The mission of the Society is to promote Cognitive Science as a discipline, and to foster scientific interchange among researchers in various areas of study, including Artificial Intelligence, Linguistics, Anthropology, Psychology, Neuroscience, Philosophy, and Education.

The Society is a non-profit professional organization and its activities include sponsoring an annual conference and publishing the journals Cognitive Science and TopiCS.

You need to log in with the email address you registered with. Access credentials have been sent to your email. 

Please be sure to check your spam and other email folders if you do not see an email confirmation right away.

Please log in to explore this event.

It looks like you are not registered for this event. 

To access the site please register [**here**](https://cognitivesciencesociety.org/registration/). 

Please register!

The 46th Annual Meeting of the Cognitive Science Society presents the latest research across cognitive science and highlights the theme of Cognition in Context.

poster

Most Chinese words are compounds formed through the combination of meaningful characters. Yet, due to compositional complexity, it is poorly understood how this compositional process would affect the access to the whole-word meaning. In the present study, we turned to the recent development in compositional distributional semantics (Marelli et al., 2017), and employed a deep neural network to learn the less-than-systematic relationship between the constituent characters and the compound words. Based on the composed representations as derived from the computational model, we quantified the extent to which the compound meaning can be predicted by nonlinearly combining the constituent meanings, i.e., the degree to which the characters could provide reliable information to access the compound meaning. We observed the effect of compositionality, as operationalized by the computed metrics, on compound recognition, over and above the effects of constituent character properties and compound properties. More importantly, we found that this effect was increasingly stronger when holistic access to the compound meaning became more challenging. These findings therefore, from a computational perspective, provided new evidence for the compositional process involved in Chinese word recognition, which also shed light on the universal process of compound comprehension.

**Authors:**

Tianqi Wang: The University of Hong Kong; Xu Xu: Shanghai Jiao Tong University

Composition as nonlinear combination in semantic space: Exploring the effect of compositionality on Chinese compound recognition

People sometimes explicitly announce that they are being sarcastic. The announcement appears to be particularly common in text-based conversations where prosodic cues are more difficult to identify. In certain cases, the tone of a comment is sufficient to determine non-literal meaning. But what happens in the absence of these features, or when context forces us to explicitly caveat our sarcasm? In this study, we examine Reddit comments from \texttt{r/AskReddit} to see the features that are present in comments tagged with \say{/s}, a convention on the platform for users to denote sarcasm. We found that a host of cues which mimic prosody, and other aspects of figures of speech, were inconsistent predictors of announced sarcasm. In contrast, when talking about sociomoral topics such as politics or race, users were more likely to tag their comments with \say{/s}. This suggests that we are more likely to announce sarcasm in text-based conversations where misinterpretation would be detrimental.

**Authors:**

Joshua Hew: University of Edinburgh; Aida Tarighat: University of Edinburgh; Martin Corley: University of Edinburgh; Zachary Horne: University of Edinburgh

Examining structural and semantic predictors of announced sarcasm on r/AskReddit

Extensive evidence from diverse areas of the cognitive sciences suggests that iconicity—the resemblance between form and its meaning—is pervasive and plays a pivotal role in the processing, memory, and evolution of human language. However, despite its acknowledged importance, iconicity in language models remains notably underexplored. This paper examines whether language models learn iconic associations between shape and sound, known as the bouba/kiki (or maluma/takete) effect, which has been widely observed in human language as well as English and multilingual vision-and-language models, including Finnish, Indonesian, Hungarian, and Lithuanian models in previous studies, using Japanese models. A comparison between the current results and the previous studies revealed that Japanese models learn language-specific aspects of iconicity, such as the associations between /p/ and roundness, and /ɡ/ and hardness, reflecting sound symbolic system in Japanese.

**Authors:**

Hinano Iida: Nagoya University; Hayate Funakura: Kyoto University

Investigating Iconicity in Vision-and-Language Models: A Case Study of the Bouba/Kiki Effect in Japanese Models

Spatial cognition and spatial language are a core site for diversity, both within and across language communities. For instance, when describing motion events, speakers through speech and gesture may anchor information either (egocentrically) to their body or (allocentrically) to geographical landmarks in the environment. Here we investigate whether the use of such egocentric versus allocentric frames of reference in co-speech gesture indeed depends on both bodily and environmental axes. In a real-world experiment, members from the traditionally allocentric Balinese community were shown small-scale motion events and asked to retell them. To evaluate the potential influence of both types of axes on gestural frame of reference use, in a 2x2 between-participant design they were assigned to conditions that contrasted the body-anchored axis the motion events unfolded on with the underlying geographical environment-anchored axis. It was observed that the type of body-anchored axis significantly predicted frame of reference representation in participants’ gestures, consistent with previous research. The type of environment-anchored axes, however, did not affect characteristics of participants’ gestures. These findings advance our understanding of the intricate interplay between language, space, culture, and environment.

**Authors:**

Danielle Naegeli: Tilburg University; David Peeters: Tilburg University; Emiel Krahmer: Tilburg University; Marieke Schouwstra: University of Amsterdam; Made Sri Satyawati: Universitas Udayana; Connie De Vos: Tilburg University

Use of spatial reference frames for motion events in Balinese co-speech gesture

Children’s spatial and numerical skills are highly related, and predictive of concurrent and future mathematical ability (Lourenco et al., 2018). The number line estimation (NLE) task, in which children indicate the spatial positions of numbers on a line, is a commonly used index of spatial-numerical ability. Critically, training studies have demonstrated a causal link between NLE and math ability (Ramani & Siegler, 2008). Nonetheless, there is extensive debate about the role of numerical and domain-general abilities in the NLE task. Here, we used fMRI with young children to assess the neural mechanisms supporting NLE performance. Whole-brain and ROI analyses yielded significant activation in bilateral intraparietal sulcus (IPS) during the NLE task, relative to matched control conditions. Moreover, we found a positive association between neural maturity in bilateral IPS during the NLE task and behavioral measures of math ability (Cantlon & Li, 2013), controlling for analogical reasoning and spatial working memory.

**Authors:**

Lauren Aulet: Carnegie Mellon University; Caroline Kaicher: Carnegie Mellon University; Jessica Cantlon: Carnegie Mellon

Converging neural evidence for number-specific mechanisms supporting number line estimation

Success in competitive matches hinges on psychological and mental preparations, such as strategic decision and emotional control. Although relevant cognitive functions and corresponding neural activity have been reported in a simple short-term laboratory task, the contribution of neural activity to the outcome of a more complex and prolonged match-format task has not been examined. Therefore, we focused on esports players engaged in a fighting video game (FVG). We examined the association between electroencephalography results in the pre-round of FVGs and consequences of the rounds. The results showed that parietal beta and frontal alpha/gamma activities are associated with winning and losing, respectively, depending on the match’s situation. Furthermore, parietal beta activity exhibited approximately 80% accuracy in win-loss predictions using machine learning. Our findings suggest that the performance of skilled video game players is influenced by psychological and mental preparations with fluctuations in neural oscillations.

**Authors:**

Sorato Minami: Kashino Diverse Brain Research Laboratory, NTT Communication Science Laboratories; Ken Watanabe: WASEDA University; Naoki Saijo: NTT Communication Science Laboratories; Makio Kashino: NTT Communication Science Laboratories

Best brain conditions for winning an esports competition: Electroencephalography amplitude in the frontal and parietal cortices associated with esports competition results

This study investigated what movements of skilled Latin American dancers make a good impression on audiences. Although there have been studies of skill development in dance movements and evaluations of the aesthetics of dance, there are no studies that have directly examined the relationship between dance movements and evaluations of those movements. We compared the Cuban Motion movements and their evaluations at different skill levels. The results show that: 1) heels and other body parts were coordinated in the R-L direction, 2) experts’ Cuban Motion’s hip trajectories were divided into symmetrical and asymmetrical groups, and 3) the symmetrical group was found to have higher Aesthetics and Dynamism factors, while the asymmetrical group had lower scores. These findings suggest that an experts Cuban Motion had the same body use in whole-body coordination, but the hip trajectory related to evaluation of Latin American dance divided into two directions for skill development.

**Authors:**

Kyoko HATSUDA: Kobe University; Daichi Shimizu: Graduate School of Human Development and Environment

Two Directions for Skill Development of Basic Latin American Dance Movements

Cognitive science has historically been introduced as a multidisciplinary field. Recent findings, however, suggest that psychology has come to disproportionately dominate cognitive science research publications. This study examines the degree of overlap between cognitive science and psychological science by comparing article keywords and author departmental affiliations extracted from flagship journals from each field over the past decade (2012-2022). The results reveal significant and consistent convergence, with over 50% of published authors stemming from psychology departments. The topics of study between the two remain similar as well. However, network analyses found fragmentation and a considerable focus by the community of cognitive scientists on modeling approaches that are absent in psychology at present. Based on the topics and socio-institutional analysis, we suggest that cognitive science is largely psychological science.

**Authors:**

Akhil Abburu: Indian Institute of Technology Delhi; Sumitava Mukherjee: Indian Institute of Technology Delhi

Cognitive Science is (largely) Psychological Science

Sentence completion studies have shown that L1 English readers use verbal aspect (VA) as a cue to disambiguate pronouns in the context of sentences with transfer of possession verbs. Specifically, in the context of a sentence like “Mary gave/was giving a book to Bill”, a subsequent pronoun is more likely to refer to the source referent (“Mary”) when the aspect is imperfective (“was giving”) than when it is perfective (“gave”). L2 studies have shown mixed results on whether L2 speakers, living within an L2 country or outside, can utilise VA as a discourse cue. The current study tested L2 English speakers using an online Maze task, where a pronoun (“He” or “She”) referring to either the source or goal referent had to be chosen at the critical point in the sentence. The results showed that both L1 speakers and L2 speakers, regardless of location, used VA as a disambiguation cue.

**Authors:**

Carine Abraham: University of Edinburgh

L2 speakers use of discourse strategies in a Maze Task

The research focus on adaptivity in complex systems has propelled an exploration of diverse interactions characterized by state transition processes. However, the investigation of functional variances among processes, rooted in fundamental operands, remains insufficient. Recognizing this gap is crucial for unveiling the constituents of state transitions and their functional boundaries during ongoing adaptivity. To address this, our central focus is on quantifying the functional variance in the interactions of fundamental operands. This approach enables a systematic study of complex adaptive networks grounded in the dynamics of cognitive abilities, where elements adapt and evolve based on cognitive processes. To underscore this point, we emphasize translating ontologically irreducible networks into functionally representable ones at the meso-level, which is essential for assessing their effectiveness. Our active investigation during state transitions explores external interventions, aiming to shed light on mutual influences.

**Authors:**

Kiran Pala: University of Eastern Finland

Premium content

Downloads

Next from CogSci 2024

Composition as nonlinear combination in semantic space: Exploring the effect of compositionality on Chinese compound recognition

Similar lecture

Eyes On the Past: visual exploration of Upper Palaeolithic cave art

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES