-
arXiv:2109.08584 [pdf, ps, other]
Learning from Crowds with Crowd-Kit
Abstract: This paper presents Crowd-Kit, a general-purpose computational quality control toolkit for crowdsourcing. Crowd-Kit provides efficient and convenient implementations of popular quality control algorithms in Python, including methods for truth inference, deep learning from crowds, and data quality estimation. Our toolkit supports multiple modalities of answers and provides dataset loaders and examp… ▽ More
Submitted 6 April, 2024; v1 submitted 17 September, 2021; originally announced September 2021.
Comments: published at JOSS
ACM Class: G.4
Journal ref: Journal of Open Source Software (2024), 9(96), 6227