Canada

Zipf’s law asserts that words form a power law distribution: word frequency is inversely proportional to rank. Relatively recent cognitive and usage-based linguistics argue that speech differs structurally from writing. Except for a few older analyses performed on tiny corpora, studies of Zipf’s law prior to 2021 have been done on written corpora and use informal methods to determine Zipfianness. 
We argue that recent work indicating that transcribed speech forms a Zipfian distribution can be extended to the speech of traditionally developing children. Further, we show that the transcribed speech of children with a clinical diagnosis of autism spectrum disorder is non-Zipfian. These judgements are made using formal statistical techniques developed in Clauset (2009). They include the Kolmogorov-Smirnov statistic for goodness-of-fit and likelihood ratio to rule out other distributions.

CogSci 2022

A First Look at Zipf&#39;s Law and the Speech of Children with Autism Spectrum Disorder

## Welcome!
"I am excited to welcome you to this year’s edition of the Conference on Empirical Methods in Natural Language Processing! Importantly, it marks the 30th edition of EMNLP. With over 8,000 submissions, more than 3,000 accepted papers, and thousands of attendees, we have come a long way from that first
workshop, which had 14 accepted papers. As the field looks ahead, Suzhou is the fitting location for celebrating this milestone: rooted in a long literary tradition, yet modern and forward-looking, and home to a large share of the NLP community." 

*Message from the General Chair, Dirk Hovy*

EMNLP 2025

Celebrate 30 Years of EMNLP! 
EMNLP 2025 will be held in Suzhou, China from November 5th to November 9th, 2025.

A First Look at Zipf's Law and the Speech of Children with Autism Spectrum Disorder

poster

Join us for CogSci2022! Our 44th Annual Conference will be centered around the theme of diversity, with an accompanying range of keynotes and invited speakers who themselves highlight the diversity of our field. Our three symposia are Cognition across Diverse Populations, Cognition within Diverse Societies, and Global Challenges for Cognitive Science. The conference is being offered in a fully hybrid environment for onsite and online attendees.
 
 [**The Program at a Glance can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2022/07/Cogsci-2022-PAAG-Detailed-July-12final-1.pdf)
 [**The Detailed Program can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2022/08/DeArmond-CogSci2022-program-v113-final.pdf)

This conference requires a registration to attend. Please use the link below to secure your ticket. The website will be available to all registered attendees on July 25th. 

[Register to Attend](https://cognitivesciencesociety.org/registration/)

Registration Is Required

The 44th Annual Meeting of the Cognitive Science Society highlighted research on the theme Cognitive Diversity in addition to the full breadth and diversity of research topics offered by the society’s membership. 





Individuals with Williams Syndrome (WS) display an unusual cognitive profile with severe deficits in spatial skills along with fluent and arguably complex language. Our experiment focused on the comprehension of scalar expressions, such as `some', `two', and `or' as a window to study their semantic and pragmatic competence. We compared performance of individuals with WS (mean age = 16,4 (year, month), age range = 11,10-21,11) to children matched by Mental Age (MA, (mean age = 6,1, age range = 5,2-7,8) and typical adults. No differences between the WS and MA groups were found in their knowledge of truth conditions of scalar terms. We further tested whether participants accept the statements with scalar terms in contexts featuring their logical (semantic) readings. Individuals with WS accepted logical readings more often than children matched by MA, suggesting that individuals with WS have access to the abstract meaning of scalar expressions.

Understanding of Linguistic Scales in Speakers with Williams Syndrome

Semantic representations of words can vary from person to person and can undergo change over the lifespan. Although a number of studies have explored differences in affective variables (e.g. valence), there has not been any large-scale investigation of the way socio-semantic information is represented, nor whether there is variation (or stability) in these representations across a diverse participant sample. We report on a study where 2,700 Czech words were rated by 1,450 Czech speakers along the dimensions of gender (feminine/masculine), location (rural/urban), political alignment (conservative/liberal), valence (negative/positive) and age (old/young). The ratings were analysed based on gender and age demographics. Our results demonstrate that distinct categories of words, e.g. those associated with mental wellbeing (such as úzkost [anxiety]) are self-associated – young participants rate the words as more young, older participants as more old. Our results shed light on the variation that exists in socio-semantic representations within different populations.

Exploring age and gender differences in socio-semantic representations of words

Polarity-sensitivity is a typologically general linguistic phenomenon. We focus on negative polarity items (NPIs, e.g. English 'any') -- expressions that are licensed only in negative contexts. The relevant notion of 'negative context' could be defined lexically, syntactically or semantically. There is psycholinguistic evidence in favour of semantics as a driving factor for some NPIs in a couple of languages (Chemla, Homer, & Rothschild, 2011; Denić, Homer, Rothschild, & Chemla, 2021). Testing the scale of this analysis as a potential cross-linguistic universal experimentally is extremely hard. We turn to recent multilingual pre-trained language models -- multilingual BERT (Devlin, Chang, Lee, & Toutanova, 2018) and XLM-RoBERTa (Conneau et al., 2019) -- and evaluate the models' recognition of polarity-sensitivity and its cross-lingual generality. Further, using the artificial language learning paradigm, we look for the connection in neural language models between semantic profiles of expressions and their ability to license NPIs. We find evidence for such connection for negation but not for other items we study.

The driving forces of polarity-sensitivity: Experiments with multilingual pre-trained neural language models

This paper proposes new empirical classifiers for evaluative concepts, including thin concepts like 'good' or 'bad' and thick concepts such as 'honest' or 'disgusting', based on quantitative corpus linguistics. Prior work in experimental philosophy has shown that sentiment analysis can be used to track differences between concept classes. Building on this, Task 1 investigates whether the relationship between sentiment and evaluativeness is parabolic rather than linear. Task 2 extends this question to the differences between evaluative and non-evaluative concept classes. The results of both Tasks show that the linear and the parabolic logistic regression classifiers perform equally well. Interestingly, this study also finds that adjectives attributed to animate entities (e.g. "generous customer") generally have a higher probability to be evaluative concepts than those attributed to inanimate entities (e.g."dry soil").

Why are reckless socks not (more of) a thing? Towards an empirical classification of evaluative concepts.

Models of word meaning, like the Topics model (Griffiths et al., 2007) and word2vec (Mikolov et al., 2013), condense word-by-context co-occurrence statistics to induce representations that organize words along semantically relevant dimensions (e.g., synonymy, antonymy, hyponymy etc.). However, their reliance on latent representations leaves them vulnerable to interference and makes them slow learners. We show how it is possible to construct the meaning of words online during retrieval to avoid these limitations. 
We implement our spreading activation account of word meaning in an associative net, a one-layer highly recurrent network of associations, called a Dynamic-Eigen-Net, that we developed to address the limitations of earlier variants of associative nets when scaling up to deal with unstructured input domains such as natural language text. After fixing the corpus across models, we show that spreading activation using a Dynamic-Eigen-Net outperforms the Topics model and word2vec in several cases when predicting human free associations and word similarity ratings. We argue in favour of the Dynamic-Eigen-Net as a fast learner that is not subject to catastrophic interference, and present it as an example of delegating the induction of latent relationships to process assumptions instead of assumptions about representation.

Constructing Word Meaning without Latent Representations using Spreading Activation

Skilled readers are typically most accurate at identifying words when fixating them slightly left of the central character, the so-called optimal viewing position. There are two main explanations for this effect, which are not mutually exclusive. The first claims that the optimal viewing position lies left-of-center due to the particular constraints of the human perceptual system. The second explains the effect in terms of the beginnings of words generally being more informative about word identity. The complexities of natural languages make it difficult to tease apart the relative contribution of each explanation. We explore this issue through the lens of a Bayesian cognitive model and two experiments using artificial lexicons in which we can carefully control how information is distributed across wordforms. Our results replicate previous findings and further suggest that readers may use implicit knowledge about information distribution to minimize uncertainty when targeting words.

Minimizing Expected Uncertainty in Visual Word Recognition: Are Readers Sensitive to the Distribution of Information across Word Forms?

Is the visual word recognition system sensitive to compound (e.g., SNOWBALL) and pseudocompound (e.g., CARPET) constituents? To answer this question, we employed red-blue anaglyphs glasses to parse red-blue colored (pseudo)compounds at the fovea—by hypothesis split along the vertical meridian—and allowing for the independent processing of word segments in the visual word form area. Seventy-one participants performed a visual masked lexical decision task with 133 millisecond stimuli presentations. Compounds and pseudocompounds were either split at the (pseudo)morpheme boundary (legally-split) or within a (pseudo)morpheme (illegally-split). We found a statistically significant interaction effect between word type and legality. Planned comparisons revealed an advantage in accuracy for legally-split compounds and pseudocompounds over their respective illegal splits. Furthermore, legally-split compounds elicited more accurate responses than legally-split pseudocompounds. In line with previous findings supporting a purely morpho-orthographic prelexical process with faster presentation times, these findings suggest a temporally distinct mechanism during visual word recognition.

Parsing Compounds and Pseudocompounds at the Fovea

Learning to read is a critical skill; yet only a small portion of children in the United States are reading at or above grade level. Attention is one crucial process that affects the
acquisition of reading skills. The process involves selectively choosing task relevant information and requires monitoring competing demands. Many books for beginning readers include illustrations, but this design choice may require learners to split their attention between multiple sources of information. This study employed eye tracking to examine whether embedding text within illustrations in children’s e-books inadvertently induces attentional competition. The results showed that spatially separating illustrations from the text in beginning reader books reduces attentional competition and improves children’s reading comprehension. This study shows that changes to the design of books for beginning readers can help promote literacy development in children.

Low Spatial Proximity Between Text and Illustrations Improves Children’s Comprehension and Attention: An Eye Tracking Study

Readers rely on sentence context to generate predictions about the upcoming words so that processing of their visual forms is less necessary. Consequently, processing of an orthographic neighbor of a strongly predicted word is facilitated by that context (as indicated by a reduced N400 ERP amplitude), regardless of the perceived item’s lexicality (i.e., whether it is a real word or a pseudoword). The current study investigated whether lexicality becomes important when the sentence context is less helpful in generating predictions. Our findings indicate that in weakly constraining sentences, the lexical status of a word impacts word recognition processes as indicated by a left anterior negativity, suggesting that readers rely on sublexical properties of words in the absence of strong expectations.

The effect of orthographic relationships, lexical status and contextual constraint on visual word recognition: Evidence from event-related potentials

It was recently found that letter-shapes have a non-arbitrary relation with their canonical pronunciations, in multiple orthographies and quantified across the whole of each orthography: letters that look similar tend to have similar pronunciations. Similarly, there is phonosemantic systematicity at the word level: words that sound similar tend to have similar meanings. We investigated for the first time whether a similar systematicity exists in Chinese characters. We measured all the pairwise phonological distances and all the pairwise orthographic distances of the 58 Chinese pictographic characters that are taught to year 1 and 2 in Chinese primary schools. The correlation was tested between the two lists of distances and verified by a Mantel test. We found a significant negative correlation between characters and their segmental pronunciations: characters that look similar tend to have dissimilar segmental pronunciations. This contrasts with the positive correlations found in previous similar research with alphabetic writing. We conclude, first, that questions of systematicity in the Chinese writing system are tractable in the same terms and by the same methodology as that applied to alphabetic writing systems. Second, segment-based processing requires to be augmented by tones for there to be systematicity that is comparable to that found in alphabetic writing systems. Any non-arbitrary relation between letter shapes and sounds may help bootstrap the acquisition of literacy.

Premium content

Downloads

Next from CogSci 2022

Understanding of Linguistic Scales in Speakers with Williams Syndrome

Similar lecture

Pre-trained Models Perform the Best When Token Distributions Follow Zipf’s Law

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES