Showing 1–1 of 1 results for author: Leong, C W

To Trust, or Not to Trust? A Study of Human Bias in Automated Video Interview Assessments

Authors: Chee Wee Leong, Katrina Roohr, Vikram Ramanarayanan, Michelle P. Martin-Raugh, Harrison Kell, Rutuja Ubale, Yao Qian, Zydrune Mladineo, Laura McCulla

Abstract: Supervised systems require human labels for training. But, are humans themselves always impartial during the annotation process? We examine this question in the context of automated assessment of human behavioral tasks. Specifically, we investigate whether human ratings themselves can be trusted at their face value when scoring video-based structured interviews, and whether such ratings can impact… ▽ More Supervised systems require human labels for training. But, are humans themselves always impartial during the annotation process? We examine this question in the context of automated assessment of human behavioral tasks. Specifically, we investigate whether human ratings themselves can be trusted at their face value when scoring video-based structured interviews, and whether such ratings can impact machine learning models that use them as training data. We present preliminary empirical evidence that indicates there might be biases in such annotations, most of which are visual in nature. △ Less

Submitted 27 November, 2019; originally announced November 2019.

Comments: ICCV Workshop on Interpreting and Explaining Visual Artificial Intelligence Models, Seoul, South Korea, 2019

ACM Class: I.2.0; H.1.2