Humans can readily generalize their learning to new visual concepts, and infer their associated meanings. How do people align the different conceptual systems learned from different modalities? In the present paper, we examine emojis— pictographs uniquely situated between visual and linguistic modalities—to explore the role of alignment and multimodality in visual and linguistic semantics. Simulation experiments show that relational structures of emojis captured in visual and linguistic conceptual systems can be aligned, and that the ease of alignment increases as the number of emojis increases. We also found that emojis with subjective impressions of high popularity are easier to align between their visual and linguistic representations, suggesting the expressive power of these emojis is likely associated with their popularity. A behavioral experiment was conducted to measure similarity patterns between 48 emojis, and to compare human similarity judgments with three models. We found that the model trained with multimodal data by aligning visual and semantic spaces best accounts for human judgments.

Human similarity judgments of emojis support alignment of conceptual systems across modalities

This session has no scheduled virtual poster presentation time, but attendees will be able to comment and ask questions about your work/research asynchronously throughout the conference.<br>

**If you are a virtual poster presenter**, you can leave a message in your poster area chat space to advise times (and time zone) that you will be available either in the chat box, or by setting up your own online meeting room (Zoom, etc.).<br>
**If you are an attendee**, please check each poster's chat box and arrange time with presenter.<br>



Virtual Posters

poster

The 45th Annual Meeting of the Cognitive Science Society will take place in Sydney, Australia as a modified hybrid conference. Presentations from the main-session room will be live-streamed every day for all events. This will include all invited talks and award sessions. Recordings of all CogSci 2023 sessions will be made available for on-demand viewing after the conference.<br>
The in-person component will be held at the International Convention Centre Sydney at Darling Harbour. The Conference will take place Wednesday July 26th – Saturday July 29th, 2023 (Wednesday, July 26th is the Workshops Day).

Join us!

<br>[**The Program at a Glance can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2023/07/COgSci-PAAG-V2.pdf)
<br>[**The Detailed Program can be found here**](https://online.fliphtml5.com/ebtyf/mswz/)
<br><br>

#### **CogSci 2023 Program Book**
<iframe style="width:700px;height:400px" src="https://online.fliphtml5.com/ebtyf/tzgk/"  seamless="seamless" scrolling="no" frameborder="0" allowtransparency="true" allowfullscreen="true" ></iframe>
<br>

CogSci 2023

The 45th Annual Meeting of the Cognitive Science Society presents the latest research across cognitive science and highlights the theme of Cognition in Context.

Yiling Yun

1

SHORT BIO

Presentations

Human similarity judgments of emojis support alignment of conceptual systems across modalities

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES