Distractor Generation for Multiple-Choice Questions: A Survey of Methods, Datasets, and Evaluation
Authors:
Elaf Alhazmi,
Quan Z. Sheng,
Wei Emma Zhang,
Munazza Zaib,
Ahoud Alhazmi
Abstract:
Distractors are important in learning evaluation. This paper surveys distractor generation tasks using English multiple-choice question datasets for textual and multimodal contexts. In particular, this paper presents a thorough literature review of the recent studies on distractor generation tasks, discusses multiple choice components and their characteristics, analyzes the related datasets, and s…
▽ More
Distractors are important in learning evaluation. This paper surveys distractor generation tasks using English multiple-choice question datasets for textual and multimodal contexts. In particular, this paper presents a thorough literature review of the recent studies on distractor generation tasks, discusses multiple choice components and their characteristics, analyzes the related datasets, and summarizes the evaluation metrics of distractor generation. Our investigation reveals that more than half of datasets are human-generated from educational sources in specific domains such as Science and English, which are largely text-based, with a lack of open domain and multimodal datasets.
△ Less
Submitted 2 February, 2024;
originally announced February 2024.
An Empirical Study on Team Formation in Online Games
Authors:
Essa Alhazmi,
Sameera Horawalavithana,
Adriana Iamnitchi,
John Skvoretz,
Jeremy Blackburn
Abstract:
Online games provide a rich recording of interactions that can contribute to our understanding of human behavior. One potential lesson is to understand what motivates people to choose their teammates and how their choices leadto performance. We examine several hypotheses about team formation using a large, longitudinal dataset from a team-based online gaming environment. Specifically, we test how…
▽ More
Online games provide a rich recording of interactions that can contribute to our understanding of human behavior. One potential lesson is to understand what motivates people to choose their teammates and how their choices leadto performance. We examine several hypotheses about team formation using a large, longitudinal dataset from a team-based online gaming environment. Specifically, we test how positive familiarity, homophily, and competence determine team formationin Battlefield 4, a popular team-based game in which players choose one of two competing teams to play on. Our dataset covers over two months of in-game interactions between over 380,000 players. We show that familiarity is an important factorin team formation, while homophily is not. Competence affects team formation in more nuanced ways: players with similarly high competence team-up repeatedly, but large variations in competence discourage repeated interactions.
△ Less
Submitted 9 August, 2017;
originally announced August 2017.
