What factors induce empathy for virtual agents? To explore this question, we examine the relationship between humans and agents in the inverted cyberball task where a participant chose to help an ostracised agent. This study especially controls experience in the preparation task from self-involvement as the base of empathy. In the one condition, participants have induced the same experience as the ostracised agent, while in the other condition, participants observed ostracising relations between two agents. As a result, self-involvement in the preparation task does not influence the helping behavior of the ostracised agent. The factor relating to the helping behavior is whether the participants noticed the relation. This notice was also associated with empathy trait. From these results, we can conclude that empathy can acquire others' perspectives even when they have no experience with the pain of ostracism.

Effect of self-experience on empathic helping to virtual agents

Although pointing is sparse, overloaded, and indirect, it allows humans to effectively decode shared information, (ex)change their minds, and plan accordingly. Pointing is an invitation to jointly attend to an object, which triggers the mutual inference between agents of each other’s mind. Relevance is a fundamental assumption underlying all human communication, including pointing. We define relevance as how much a signaler’s belief can make a positive difference to its receiver’s well being. We build a Theory of Mind (ToM) model to test our definition of relevance and use pointing as a case study. In two experiments, we test our relevance model in a classic artificial intelligence (AI) task, the Wumpus world, with the key difference that there is a guide that points to help a hunter. Agents with our relevance model gain significantly higher rewards than agents who ignore signals from the guide. Agents with our model also achieve better performance than agents who receive an additional observation of the environment. The results show that the power of pointing comes from the ToM inference of relevance, rather than providing more precise individual perception.

What Is the point? a Theory of Mind Model of Relevance

The ancient Greek hero Ulysses chose to bind himself to resist the temptation of Sirens, highlighting the fact that humans may voluntarily sacrifice their freedom of choice to achieve committed goals. In this work, we propose a computational model for such commitment under the framework of Bayesian Theory of Mind. The model is based on the idea that even when alone, humans act to better demonstrate their intentions to an imagined third-party observer (ITO) censoring their actions. Our model successfully captures the Ulysses-constraint of freedom, as the freedom confuses the ITO’s inference of their intention. We further show that, trajectories generated both by human actors and actors modeled with ITO censorship are easy to interpret both in the eyes of an actual human ob- server and an ITO. The results demonstrate that under conflict- ing desires, humans achieve commitment by spontaneously censoring their actions with an internalized theory of mind.

Intentional commitment through an internalized theory of mind: Acting in the eyes of an imagined observer

Inferring others' preferences is one of the central cognitive tasks of social life. The inferred preferences are used to predict the behavior of others in novel situations; therefore, a certain level of abstraction is required. We considered the inference of preferences as a classification problem on an abstract latent feature space. Participants (n=96) were asked to show 89 images of automobiles to either an agent that had been programmed with a specific person's preference and which showed facial expressions according to that preference or an agent that did not show facial expressions. Next, participants were asked to predict the agent's likes and dislikes for novel 23 automobiles. The results showed that participants could predict the agent's likes and dislikes for the unseen automobiles with 74% accuracy, indicating that they learned the decision boundary of agents' preferences on the latent feature space using expressions of emotion as labels.

People learn other's preferences on a latent feature space using emotion expressions as labels

People collaborate daily to achieve joint goals, negotiating sidewalks, preparing meals, constructing furniture. Here we analyzed how strangers coordinate a complex novel task, assembling a TV cart. Before beginning and before major actions, partners used a photo of the completed cart, speech, and gesture to establish a joint model of the structure of the completed cart. Most coordination was implicit, a conversation of actions that could be understood in the context of the current state of the object and the shared mental representation. Actions served a dual purpose, both to communicate and to advance the task. The basic unit of coordination was the dyad, not the individual.

Explicit and Implicit Coordination of Joint Action

With the growing ubiquity of computation in STEM fields, understanding how to teach computational thinking (CT) practices has become an active research area in the last two decades, with particular emphasis on developing CT frameworks. In this paper, we apply one of these CT frameworks and correlate the results with a task analysis to examine how CT practices relate to specific design features of an in-class problem. We have analyzed video data from two separate groups working on one computational class period, which utilizes a minimally working program to model magnetic field vectors. While still in the initial stages of the study, our preliminary results indicate that what is left out of the minimally working program will impact the CT practices students use, particularly around building computational models. Ultimately, we hope this work will help instructors to design activities that can target & build specific CT practices.

Relating Computational Thinking Practices and Problem Design Features

Adversarial attacks are a major challenge faced by current machine learning research. These purposely crafted inputs fool even the most advanced models, precluding their deployment in safety-critical applications. Extensive research in computer vision has been carried to develop reliable defense strategies. However, the same issue remains less explored in natural language processing. Our work presents a model-agnostic detector of adversarial text examples. The approach identifies patterns in the logits of the target classifier when perturbing the input text. The proposed detector improves the current state-of-the-art performance in recognizing adversarial inputs and exhibits strong generalization capabilities across different NLP models, datasets, and word-level attacks

"That Is a Suspicious Reaction!": Interpreting Logits Variation to Detect NLP Adversarial Attacks

Surface Code 1 (theory perspective)

In the absence of gold standard for evaluating quality of peer review, considerable attention has been focused on studying reviewer agreement via inter-rater reliability (IRR) which can be thought of as the correlation between scores of different reviewers given to the same grant proposal. Noting that it is not uncommon for IRR in grant peer review studies to be estimated from some range-restricted subset of submissions, we use statistical methods and data analysis of real peer review data to illustrate behavior of such local IRR estimates when only fractions of top-quality proposal submissions are considered. We demonstrate that local IRR estimates are smaller than those obtained from all submissions and that zero local IRR estimates are quite plausible. We note that, from a measurement perspective, when reviewers are asked to differentiate among grant proposals across the whole range of submissions, only IRR measures that correspond to the complete range of submissions are warranted. We recommend against using local IRR estimates in those situations. Moreover, if review scores are intended to be used for differentiating among top proposals, we recommend peer review administrators and researchers to align review procedures with their intended measurement.

Local versus global inter-rater reliability for evaluating the internal validity of grant peer review: Considerations of measurement

In peer review, reviewers often have formal and informal occasions to interact with other reviewers of the same grant proposal or submission. The former happens, for example, when grant proposals are evaluated by sitting review panels who are tasked with collectively deciding the fate of a particular proposal. Despite the scholarly consensus that interactions (and thus social influence) can alter the outcome of collective decision making, to date social influence has rarely been a theoretical ingredient in simulation models of peer review. In our contribution we use a simple agent-based model of peer review to show that social influence processes can indeed change the dynamics and outcome of peer review. With our simulation experiment we showcase the incorporation of social influence processes in peer review models as a promising direction for future research.

Underline digital video library

Effect of self-experience on empathic helping to virtual agents

What Is the point? a Theory of Mind Model of Relevance

Intentional commitment through an internalized theory of mind: Acting in the eyes of an imagined observer

People learn other's preferences on a latent feature space using emotion expressions as labels

Explicit and Implicit Coordination of Joint Action

Relating Computational Thinking Practices and Problem Design Features

"That Is a Suspicious Reaction!": Interpreting Logits Variation to Detect NLP Adversarial Attacks

Surface Code 1 (theory perspective)

Local versus global inter-rater reliability for evaluating the internal validity of grant peer review: Considerations of measurement

Does social influence matter in peer review?

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES