![profile picture](https://assets.underline.io/profile/103908/square_avatar/medium-3663aebe779d09610799d8b004c17073.jpg)
Joyce Chai
University of Michigan
large language model
mistake detection
vision-and-language navigation
compositional concpet learning
foundation models
perceptual guidance
language acquisition
situated dialogue
augmented reality
autonomous vehicles
grounding
multimodal models
task guidance
reproducibility
communication
24
presentations
25
number of views
SHORT BIO
Joyce Y. Chai is a professor in the Computer Science and Engineering department at the University of Michigan (UM). She is a member of Michigan AI Lab and directing the Situated Language and Embodied Dialogue (SLED) research group. She is also affiliated with Michigan Robotics Institute. Her research interests are in the area of artificial intelligence, particularly on natural language processing, situated and embodied dialogue agents, human-robot communication, and intelligent user interfaces. Her recent work has focused on grounded language processing to facilitate situated communication with robots and other artificial agents. Prior to joining UM, she was a professor at Michigan State University (MSU) directing the Language and Interaction Research Lab (LAIR). She received a Ph.D. in Computer Science from Duke University.
Presentations
![](https://assets.underline.io/lecture/90273/poster_document_thumbnail_extract/medium-5a03b0f0210ddf41ca60324431fc479e.jpg)
MetaReVision: Meta-Learning with Retrieval for Visually Grounded Compositional Concept Acquisition
Guangyue Xu and 2 other authors
![](https://assets.underline.io/lecture/90275/poster_document_thumbnail_extract/medium-849f3dfeddf98e9645af90e389d90196.jpg)
Can Foundation Models Watch, Talk and Guide You Step by Step to Make a Cake?
Yuwei Bao and 8 other authors
![](https://assets.underline.io/lecture/89725/poster_document_thumbnail_extract/medium-f55500015ae3c5eb0cccad1bcf83c438.jpg)
Towards A Holistic Landscape of Situated Theory of Mind in Large Language Models
Ziqiao Ma and 3 other authors
![](https://assets.underline.io/lecture/89447/poster_document_thumbnail_extract/medium-58de945226e234f73315d6eef5a5ac04.jpg)
From Heuristic to Analytic: Cognitively Motivated Strategies for Coherent Physical Commonsense Reasoning
Zheyuan Zhang and 6 other authors
![](https://assets.underline.io/lecture/89011/poster_document_thumbnail_extract/medium-79d72f8ddba2ec05aad26edbf0985120.jpg)
Grounding Visual Illusions in Language: Do Vision-Language Models Perceive Illusions Like Humans?
Yichi Zhang and 4 other authors
![](https://assets.underline.io/lecture/91300/poster_document_thumbnail_extract/medium-ab3e349048feb9bab66cdbefe052b4a4.jpg)
Can Foundation Models Watch, Talk and Guide You Step by Step to Make a Cake?
Yuwei Bao and 8 other authors
![](https://assets.underline.io/lecture/76986/poster_document_thumbnail_extract/medium-3fd8ea215c3544c2325cfcb30be7fc50.jpg)
World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Language Models
Ziqiao Ma and 2 other authors
![](https://assets.underline.io/lecture/77003/poster_document_thumbnail_extract/medium-d4d00bab7c0f4a370e0659e0f3b4091c.jpg)
Human Inspired Progressive Alignment and Comparative Learning for Grounded Word Acquisition
Yuwei Bao and 2 other authors
![](https://assets.underline.io/lecture/76995/poster_document_thumbnail_extract/medium-5482c8f4c74714b0d529e975c6517a1b.jpg)
In-Context Analogical Reasoning with Pre-Trained Language Models
Xiaoyang Hu and 3 other authors
![](https://assets.underline.io/lecture/77002/poster_document_thumbnail_extract/medium-d256efdf1f385bc591d3fc5a653fccf3.jpg)
NLP Reproducibility For All: Understanding Experiences of Beginners
Shane Storks and 3 other authors
![](https://assets.underline.io/lecture/72156/poster/medium-c10712909b93765a681dd5ea854d5d94.png)
Language Use in Embodied AI
Joyce Chai
![](https://assets.underline.io/lecture/65460/poster/medium-f6e26583d006695b0004e6c922a2fd61.png)
DANLI: Deliberative Agent for Following Natural Language Instructions
Yichi Zhang and 8 other authors
![](https://assets.underline.io/lecture/66990/poster_document_thumbnail_extract/medium-86ce8fb322e746a14e4cc198ea830090.jpg)
DOROTHIE: Spoken Dialogue for Handling Unexpected Situations in Interactive Autonomous Driving Agents
Ziqiao Ma and 7 other authors
![](https://assets.underline.io/lecture/50468/poster_document_thumbnail_extract/medium-c69fc8f1627803f72e68d8ed21a4b503.jpg)
Learning to Mediate Disparities Towards Pragmatic Communication
Yuwei Bao and 2 other authors
![](https://assets.underline.io/lecture/38744/poster_document_thumbnail_extract/medium-0a86d1a1632d98351fd22995a554b284.jpg)
MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Tasks
Cristian-Paul Bara and 2 other authors
![](https://assets.underline.io/lecture/37814/poster/medium-39876de106b537d9cc865806c0f792f2.jpg)
MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Tasks
Cristian-Paul Bara and 2 other authors