Machine learning (ML) based systems are frequently used to assist human decision makers, in scenarios ranging from medical diagnostics, to bail decision-making. To understand and moderate the effects of using ML based decision aids in practice, it is necessary to understand how human decision makers interact with the machine decision aids. In this talk, we focus on two aspects of this human-machine interaction: (i) human perceptions of algorithmic fairness, and (ii) machine-assisted human decision-making.
In our study of algorithmic fairness, we take a descriptive, human-centred approach. Using tools designed to assist judges with making bail decisions as a case study, we study how people reason about the fairness of using certain input features for making bail decisions, and propose ML algorithms that account for these moral considerations.
When exploring the problem of machine-assisted decision-making, we go beyond studying the accuracy and fairness of machine decision aids. We focus on understanding how ML-based decision aids influence the decisions of the human decision makers that they are assisting, and on identifying the factors which determine and moderate the magnitude of this influence.

Accounting for Human Factors in Machine-Assisted Decision-Making

**Session Chairs:** Maribel Acosta and Markus Krause



Doctoral Consortium Session 1

technical paper

The 8th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2020) will be held October 26–28th virtually at The Netherlands Institute for Sound and Vision in Hilversum, The Netherlands.

While artificial intelligence (AI) and human-computer interaction (HCI) represent traditional mainstays of the conference, HCOMP believes strongly in fostering and promoting broad, interdisciplinary research. Our field is particularly unique in the diversity of disciplines it draws upon and contributes to, including human-centered qualitative studies and HCI design, social computing, artificial intelligence, economics, computational social science, digital humanities, policy, and ethics. We promote the exchange of advances in human computation and crowdsourcing not only among researchers, but also engineers and practitioners, to encourage dialogue across disciplines and communities of practice.

This year, we especially invite works that will generate new insights into the quality (or qualities) of human-annotated datasets, including elements such as reliability and replicability of human computation and crowdsourcing experiments, novel metrics for aggregation of results, and holistic approaches to deal with bias, fairness and interpretability.

HCOMP 2020

HCOMP believes strongly in fostering and promoting broad, interdisciplinary research. Our field is particularly unique in the diversity of disciplines it draws upon and contributes to, including human-centered qualitative studies and HCI design, social computing, artificial intelligence, economics, computational social science, digital humanities, policy, and ethics. 


Nina Grgić-Hlača

1

5

SHORT BIO

Presentations

Accounting for Human Factors in Machine-Assisted Decision-Making

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES