United States

Human communication involves far more than words; speakers’ utterances are often accompanied by various kinds of emotional expressions. How do listeners represent and integrate these distinct sources of information to make communicative inferences? We first show that people, as listeners, integrate both verbal and emotional information when inferring true states of the world and others&#39; communicative goals, and then present computational models that formalize these inferences by considering different ways in which these signals might be generated. Results suggest that while listeners understand that utterances and emotional expressions are generated by a balance of speakers’ informational and social goals, they additionally consider the possibility that emotional expressions are noncommunicative signals that directly reflect the speaker’s internal states. These results are consistent with the predictions of a probabilistic model that integrates goal inferences with linguistic and emotional signals, moving us towards a more complete formal theory of human communicative reasoning.

CogSci 2021

Integrating emotional expressions with utterances in pragmatic inference

## **The Linguistic Construction of Emotional Challenges in a Changing Society**


**Languaging Diversity** is the itinerating conference of the [I-Land Interuniversity Research Centre](https://www.unior.it/index2.php?content_id=14038&content_id_start=1&titolo=i-land-research-centre&parLingua=ENG), an international independent and interdisciplinary center for advanced studies in Linguistics, Social Sciences and the Humanities with a focus on the key notions of identity and diversity, from a linguistic, cultural, and gender studies perspective, in and across cultures. 

Following the six successful events hosted by the Universities of Naples (2013), Catania (2014), Macerata (2016), Cagliari (2017), Antwerp (2018) and Teruel (2019), the seventh edition of the Languaging Diversity Conference (LD2021) will be organized by the University of Lille, France. Due to the COVID-19 ongoing pandemic, the event will be held exclusively online via the virtual conference management platform [Underline](https://underline.io/).


**Focus **

The 7th edition of the Languaging Diversity Conference (LD2021) focuses on the emotional challenges that result from the social innovations of the last two decades, and on the way such experiences are expressed in discourse. Conference convenors invite papers and posters that investigate the intersection of emotion, communication and social change, also within the framework of digital communication. The contributions presented at the LD2021 conference will explore the expression of emotion(s) at the different levels of linguistic description (phonological, morphological, syntactic, lexical, semantic, pragmatic, discursive), and in texts and contexts related to traditional and digital genres in different domains, including (but not restricted to) health, medicine and science, media, politics, the law, academia, the world of corporate and institutional work, education and learning. 


**Conference convenors**

* Giuditta Caliendo, Université de Lille & STL, France
* Maarten Lemmens, Université de Lille & STL, France
* Mégane Lesuisse, Université de Lille & STL, France

 
**Scientific Committee**

* Giuseppe Balirano, Università degli Studi di Napoli ‘l’Orientale’, Italy
* Henry Hernandez Bayter, Université de Lille & STL, France
* Stéphanie Caët, Université de Lille & STL, France
* Giuditta Caliendo, Université de Lille & STL, France
* Bert Cappelle, Université de Lille & STL, France
* Paola Catenaccio, Università degli Studi di Milano, Italy
* Emmanuelle Canut, Université de Lille & STL, France
* Stefania D’Avanzo, Università degli Studi della Campania ‘Luigi Vanvitelli’, Italy
* Ilse Depraetere, Université de Lille & STL, France
* Emilia Di Martino, Università degli Studi ‘Suor Orsola Benincasa’, Italy
* Antonio Fruttaldo, Università degli Studi di Napoli ‘l’Orientale’, Italy
* Dariusz Galasiński, Uniwersytet Wrocławski, Poland
* Kim Grego, Università degli Studi di Milano, Italy
* Siria Guzzo, Università degli Studi di Salerno, Italy
* Geert Jacobs, Universiteit Gent, Belgium
* Samantha Laporte, Université de Lille & STL, France
* Maarten Lemmens, Université de Lille & STL, France
* Mégane Lesuisse, Université de Lille & STL, France
* Jeannette Littlemore, University of Birmingham, UK
* Julien Longhi, Université de Cergy-Pontoise, France
* Corinne Oster, Université de Lille & CECILLE, France
* Paolo Mairano, Université de Lille & STL, France
* Antonella Napolitano, Università del Sannio, Italy
* Maria Cristina Nisco, Università degli studi di Napoli ‘Parthenope’, Italy
* Annick Rivens Mompean, Université de Lille & STL, France 
* Margaret Rasulo, Università degli Studi della Campania ‘Luigi Vanvitelli’, Italy
* Catherine Ruchon,Université Sorbonne Paris Nord -Pléiade, France
* Hans-Jörg Schmid, LMU München, Germany
* Jerome Tessuto, Università degli Studi della Campania ‘Luigi Vanvitelli’, Italy


[**Organizing Committee**](https://ld2021.sciencesconf.org/)

* Giuditta Caliendo, Université de Lille & STL, France
* Justin Duquesnoy, Université de Lille & STL, France
* Océane Foubert, Université de Lille & STL, France
* Lola Marinato, Université de Lille & STL, France
* Maarten Lemmens, Université de Lille & STL, France
* Mégane Lesuisse, Université de Lille & STL, France
* Sayf-Eddine Mohamed, Université de Lille & STL, France

**Keynote Speakers**

**Maïa Ponsonnet**
<iframe width=640 height=360 style="border:0;" scrolling="no" src="https://screencast-o-matic.com/watch/crQUbGV6Kgz" allowfullscreen="true"></iframe>

**Jeannette Littlemore**
<iframe width=640 height=360 style="border:0;" scrolling="no" src="https://screencast-o-matic.com/watch/cr6i2TVX2d0" allowfullscreen="true"></iframe>

**Andrea Scarantino**
<iframe width=640 height=360 style="border:0;" scrolling="no" src="https://screencast-o-matic.com/watch/crQUbEV6KgI" allowfullscreen="true"></iframe>

To access the **Languaging Diversity 2021** conference, please remember to [register.](https://ld2021.sciencesconf.org/registration) 

Languaging Diversity 2021

Languaging Diversity  is the itinerating conference of the I-Land Interuniversity Research Centre, an international independent and interdisciplinary center for advanced studies in Linguistics, Social Sciences and the Humanities with a focus on the key notions of identity and diversity, from a linguistic, cultural, and gender studies perspective, in and across cultures. 

Human communication involves far more than words; speakers’ utterances are often accompanied by various kinds of emotional expressions. How do listeners represent and integrate these distinct sources of information to make communicative inferences? We first show that people, as listeners, integrate both verbal and emotional information when inferring true states of the world and others' communicative goals, and then present computational models that formalize these inferences by considering different ways in which these signals might be generated. Results suggest that while listeners understand that utterances and emotional expressions are generated by a balance of speakers’ informational and social goals, they additionally consider the possibility that emotional expressions are noncommunicative signals that directly reflect the speaker’s internal states. These results are consistent with the predictions of a probabilistic model that integrates goal inferences with linguistic and emotional signals, moving us towards a more complete formal theory of human communicative reasoning.

poster

### Looking for Cogsci 2023? Please [click here](https://underline.io/events/405/reception) to switch to 2023 edition.


**Dear Colleagues,**

Welcome to the 43rd Annual Conference of the Cognitive Science Society! 

This year’s conference brings together the latest research from all Cognitive Science and also highlights this year’s theme **Comparative Cognition: Animal Minds.** 

The program features four plenary speakers: Friederike Range (University of Veterinary Medicine, Vienna), Onur Güntürkün (Ruhr University Bochum), Julia Fischer (University of Göttingen), and Erich Jarvis (The Rockefeller University). The keynotes and invited symposia showcase the broad spectrum of ideas that encompass the conference theme of comparative cognition. 

Further, the program includes the Rumelhart Prize keynote presentation by Susan Goldin-Meadow (University of Chicago), and symposia to celebrate the winner of the Elman Prize: Wei Ji Ma (New York University), the Heineken Award winner Robert Zatorre (McGill University), and the Robert J. Glushko Dissertation Prizes session.

The program committee for CogSci 2021 received 1,025 submissions, including 710 full papers, 275 member abstracts, 8 publication-based talks, as well as 15 proposals for symposia, and 17 for workshops and tutorials. After a rigorous review process, the committee selected 152 papers for oral presentation and inclusion in the conference proceedings (14.8%), 332 papers for poster presentation and inclusion in the proceedings (32.4%), and 175 papers for poster presentation with inclusion of abstracts in the proceedings (17.1%) We also selected 275 submitted member abstracts. In addition, we accepted 6 publication-based talks, 12 symposia, and 9 workshops and tutorials to make for an exciting and inclusive program.

We hope that you enjoy the conference this year!<br><br>

**Your Program Chairs,**
![](https://assets.underline.io/uploads/markdown_image/1/image/99984908caba5e6453e5fc5ba34f3507.jpg)

**Learn more about the Vienna Cognitive Science Hub at the University of Vienna, hosts of CogSci 2021**

<iframe width="560" height="315" src="https://www.youtube.com/embed/464h1m3iU68" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>

To review the proceedings for the conference or review the searchable program, please visit the [website](https://cognitivesciencesociety.org/program/).


The Cognitive Science Society brings together researchers from around the world who hold a common goal: understanding the nature of the human mind. The mission of the Society is to promote Cognitive Science as a discipline, and to foster scientific interchange among researchers in various areas of study, including Artificial Intelligence, Linguistics, Anthropology, Psychology, Neuroscience, Philosophy, and Education. The Society is a non-profit professional organization and its activities include sponsoring an annual conference and publishing the journals Cognitive Science and TopiCS.

To convey meaning, language relies on hierarchically organized, long-range relationships spanning words, phrases, sentences, and discourse. As the distances between elements in language sequences increase, the strength of the long range relationships between those elements decays following a power law. This power-law relationship has been attributed variously to long-range sequential organization present in language syntax, semantics, and discourse structure. However, non-linguistic behaviors in numerous phylogenetically distant species, ranging from humpback whale song to fruit fly motility, demonstrate similar long-range statistical dependencies. Therefore, we hypothesized that long-range statistical dependencies in speech may occur independently of linguistic structure. To test this hypothesis, we measured long-range dependencies in speech corpora from children (aged 6 months -- 12 years). We find that adult-like power-law statistical dependencies are present in human vocalizations prior to the production of complex linguistic structure. These linguistic structures cannot, therefore, be the sole cause of long-range statistical dependencies in language.

Long-range sequential dependencies precede complex syntactic production in language acquisition

Previous studies have found that bilingual children receive different Give-Number task knower-levels across their languages as subset-knowers. However, recent work reveals that the reliability of Give-Number task is moderate for subset-knower levels. This raises the possibility that the differences found in knower-levels across bilinguals’ languages are explained by a lack of reliability of Give-Number. To address this possibility, we presented bilingual children with Give-Number and a subitizing task that they had to perform in both languages. If differences in knower-levels are due to true differences in children’s understanding of small numbers and not random noise, then differences in subitizing abilities should also be non-random. Data collection is still in progress, but preliminary planned analyses (N=13/64) revealed no differences in subitizing abilities across languages, based on knower-levels classification. We discuss implications of these findings on knowledge transfer across bilinguals’ languages.

Subitizing Abilities of Bilingual Subset-Knowers

Speakers use different language to communicate with partners in different communities. But how do we learn and represent which conventions to use with which partners? In this paper, we argue that solving this challenging computational problem requires speakers to supplement their lexical representations with knowledge of social group structure. We formalize this idea by extending a recent hierarchical Bayesian model of convention formation with an intermediate layer explicitly representing the latent communities each partner belongs to, and derive predictions about how conventions formed within a group ought to extend to new in-group and out-group members. We then present evidence from two behavioral experiments testing these predictions using a minimal group paradigm. Taken together, our findings provide a first step toward a formal framework for understanding the interplay between language use and social group knowledge.

Respect the code: Speakers expect novel conventions to generalize within but not across social group boundaries

Human language is often assumed to make "infinite use of finite means" - that is, to generate an infinite number of possible utterances from a finite number of building blocks. From an acquisition perspective, this assumed property of language is interesting because learners must acquire their languages from a finite number of examples. To acquire an infinite language, learners must therefore generalize beyond the finite bounds of the linguistic data they have observed. In this work, we use an artificial language learning experiment to investigate whether people generalize in this way. We train participants on sequences from a simple grammar featuring center embedding, where the training sequences have at most two levels of embedding, and then evaluate whether participants accept sequences of a greater depth of embedding. We find that, when participants learn the pattern for sequences of the sizes they have observed, they also extrapolate it to sequences with a greater depth of embedding. These results support the hypothesis that the learning biases of humans favor languages with an infinite generative capacity.

Infinite use of finite means? Evaluating the generalization of center embedding learned from an artificial grammar

Previous literature suggests that the language processor generates expectations about upcoming material. Several studies have found evidence for a prediction error cost in cases where the comprehender encountered not the predicted word but a plausible unexpected continuation instead. This cost is argued to be a result of an inhibitory process that suppresses activation of the originally predicted word. Others have found no such evidence for a prediction cost. In a probe recognition memory task, we find evidence for interference from an incorrectly predicted word, and in a self-paced reading study, we find evidence for facilitation when the originally predicted word is encountered later on. Taken together, our results provide evidence against a strong version of the suppression account, in which incorrectly predicted words are fully inhibited. Instead we argue in favor of a passive lingering activation account, in which activation for the disconfirmed prediction gradually decays over time.

Unexpected guests: When disconfirmed predictions linger

Infant vocabulary development is inevitably dependent on the speech they hear in their environment. This paper reports an investigation of the vocabulary statistics that predict a word’s age of acquisition, focusing on frequency and contextual diversity as derived from child-directed speech data along with associative norms generated by adults. Age of acquisition is operationalised using parental-report of infant word knowledge in a British English-speaking population. The work can be considered an extension of Hills, Maouene, Riordan, and Smith (2010) using a fully British English dataset. We found significant effects of both word frequency and word associations on age of acquisition. Interestingly, the strength of these predictors differed between word classes, with frequency being the strongest predictor for nouns and associations the strongest predictor for function words.

Exploring the variable effects of frequency and semantic diversity as predictors for a word's ease of acquisition in different word classes

The speed-accuracy tradeoff (SAT) method has produced several prominent findings in sentence processing. While a substantial number of SAT studies has yielded statistical null results regarding the degree to which certain factors influence the speed of sentence processing operations, the statistical power of the SAT paradigm is not known. As a result, it is not entirely clear how to interpret these findings. We addressed this problem by means of a simulation study in which we simulated SAT experiments for a range of known effect sizes in order to determine the statistical power in typical SAT experiments. We found that while SAT experiments appear to have quite satisfactory power to detect differences in asymptotic accuracy, that is not the case for speed-related parameters. We conclude that the failure to find an effect in speed-related parameters in SAT experiments may be less meaningful than previously thought.

Statistical Power in Response Signal Paradigm Experiments

Features of the physical world may be acquired from the statistical properties of language. Here we investigate how the Transformer Language Model T5 is able to gain knowledge of the visual world without being able to see or feel. In a series of four studies, we show that T5 possesses an implicit understanding of the relative sizes of animals, their weights, and their shapes, but not their colors, that aligns well with that of humans. As the size of the models was increased from 60M to 11B parameters, we found that the fit to human judgments improved dramatically, suggesting that the difference between humans and these learning systems might ultimately disappear as the parameter sizes grow even larger. The results imply that knowledge of the perceptual world—and much of semantic memory—might be acquired in dis-embodied learning systems using real-time inferential processes

What Transformers Might Know About the Physical World: T5 and the Origins of Knowledge

Bilinguals are reported to have language learning advantages. One possible pathway is a language-specific transfer effect, whereby sensitivity to structural regularities in known languages can be brought to novel languages that share features. To test for specific linguistic feature transfer, we designed a task for bilinguals with homogeneous language exposure (bilingual in same languages) and heterogeneous feature representation (differing proficiencies). As Hindi and Mandarin have retroflexion in phoneme contrasts, we conducted a pre-registered study with a statistical learning task of a Hindi dental-retroflex contrast on parallel English-Mandarin bilinguals with varied Mandarin proficiency. Unlike the pilot study (N = 15), the main study (N = 50) found no evidence for a learning effect, and language-experience did not explain learning variance. As these stimuli have shown learning effects in children, learning effects for this feature may be fragile in this adult population, and language-specific neural commitments may prevent learning of the contrast.

A preregistered study exploring language-specific distributional learning advantages in English-Mandarin bilingual adults

In isolated word reading, readers have the best performance when fixating between the beginning and center of a word, i.e., the optimal viewing position (OVP). Also, perceptual expertise literature suggests that both global and local processing are important for visual stimulus recognition. Here we showed that in lexical decision, higher similarity to an eye movement pattern that focused at the OVP and better local processing ability predicted faster response time (RT), in addition to verbal working memory and lexical knowledge. Also, this eye movement pattern was associated with longer RT in naming isolated single letters, suggesting conflicting visual abilities required for identifying isolated letters and letter strings. In contrast, word and pseudoword naming RT, and lexical decision and naming accuracy, were predicted by lexical knowledge but not eye movement pattern or global-local processing abilities. Thus, visual processing abilities are important factors accounting for isolated word reading fluency not involving naming.

Downloads

Next from CogSci 2021

Long-range sequential dependencies precede complex syntactic production in language acquisition

Similar lecture

How to do things with emotional expressions

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES