-
Is that a Duiker or Dik Dik Next to the Giraffe? Impacts of Uncertainty on Classification Efficiency in Citizen Science
Authors:
Vinod Kumar Ahuja,
Holly K. Rosser,
Andrea Grover
Abstract:
Quality control is an ongoing concern in citizen science that is often managed by replication to consensus in online tasks such as image classification. Numerous factors can lead to disagreement, including image quality problems, interface specifics, and the complexity of the content itself. We conducted trace ethnography with statistical and qualitative analyses of six Snapshot Safari projects to…
▽ More
Quality control is an ongoing concern in citizen science that is often managed by replication to consensus in online tasks such as image classification. Numerous factors can lead to disagreement, including image quality problems, interface specifics, and the complexity of the content itself. We conducted trace ethnography with statistical and qualitative analyses of six Snapshot Safari projects to understand the content characteristics that can lead to uncertainty and low consensus. This study contributes content categorization based on aggregate classifications to characterize image complexity, with analysis that confirms that the categories impact classification efficiency, and an inductively generated set of additional image quality issues that also impact volunteers' ability to confidently classify content. The results suggest that different conceptualizations and measures of consensus may be needed for different types of content, and aggregate responses offer a way to identify content that needs different handling when complexity cannot be determined $a$ $priori$.
△ Less
Submitted 14 October, 2021;
originally announced October 2021.
-
Magnetic properties and signatures of moment ordering in triangular lattice antiferromagnet KCeO$_2$
Authors:
Mitchell M. Bordelon,
Xiaoling Wang,
Daniel M. Pajerowski,
Arnab Banerjee,
Mark Sherwin,
Craig M. Brown,
M. S. Eldeeb,
T. Petersen,
L. Hozoi,
U. K. Rößer,
Martin Mourigal,
Stephen D. Wilson
Abstract:
The magnetic ground state and the crystalline electric field level scheme of the triangular lattice antiferromagnet KCeO$_2$ are investigated. Below $T_N =$ 300 mK, KCeO$_2$ develops signatures of magnetic order in specific heat measurements and low energy inelastic neutron scattering data. Trivalent Ce$^{3+}$ ions in the $D_{3d}$ local environment of this compound exhibit large splittings among t…
▽ More
The magnetic ground state and the crystalline electric field level scheme of the triangular lattice antiferromagnet KCeO$_2$ are investigated. Below $T_N =$ 300 mK, KCeO$_2$ develops signatures of magnetic order in specific heat measurements and low energy inelastic neutron scattering data. Trivalent Ce$^{3+}$ ions in the $D_{3d}$ local environment of this compound exhibit large splittings among the lowest three $4f^1$ Kramers doublets defining for the free ion the $J = 5/2$ sextet and a ground state doublet with dipole character, consistent with recent theoretical predictions in M. S. Eldeeb et al. Phys. Rev. Materials 4, 124001 (2020). An unexplained, additional local mode appears, and potential origins of this anomalous mode are discussed.
△ Less
Submitted 21 September, 2021;
originally announced September 2021.
-
Sim2real gap is non-monotonic with robot complexity for morphology-in-the-loop flap** wing design
Authors:
Kent Rosser,
Jia Kok,
Javaan Chahl,
Josh Bongard
Abstract:
Morphology of a robot design is important to its ability to achieve a stated goal and therefore applying machine learning approaches that incorporate morphology in the design space can provide scope for significant advantage. Our study is set in a domain known to be reliant on morphology: flap** wing flight. We developed a parameterised morphology design space that draws features from biological…
▽ More
Morphology of a robot design is important to its ability to achieve a stated goal and therefore applying machine learning approaches that incorporate morphology in the design space can provide scope for significant advantage. Our study is set in a domain known to be reliant on morphology: flap** wing flight. We developed a parameterised morphology design space that draws features from biological exemplars and apply automated design to produce a set of high performance robot morphologies in simulation. By performing sim2real transfer on a selection, for the first time we measure the shape of the reality gap for variations in design complexity. We found for the flap** wing that the reality gap changes non-monotonically with complexity, suggesting that certain morphology details narrow the gap more than others, and that such details could be identified and further optimised in a future end-to-end automated morphology design process.
△ Less
Submitted 30 October, 2019;
originally announced October 2019.
-
Citizen Science: An Information Quality Research Frontier
Authors:
Roman Lukyanenko,
Andrea Wiggins,
Holly K. Rosser
Abstract:
The rapid proliferation of online content producing and sharing technologies resulted in an explosion of user-generated content (UGC), which now extends to scientific data. Citizen science, in which ordinary people contribute information for scientific research, epitomizes UGC. Citizen science projects are typically open to everyone, engage diverse audiences, and challenge ordinary people to produ…
▽ More
The rapid proliferation of online content producing and sharing technologies resulted in an explosion of user-generated content (UGC), which now extends to scientific data. Citizen science, in which ordinary people contribute information for scientific research, epitomizes UGC. Citizen science projects are typically open to everyone, engage diverse audiences, and challenge ordinary people to produce data of highest quality to be usable in science. This also makes citizen science a very exciting area to study both traditional and innovative approaches to information quality management. With this paper we position citizen science as a leading information quality research frontier. We also show how citizen science opens a unique opportunity for the information systems community to contribute to a broad range of disciplines in natural and social sciences and humanities.
△ Less
Submitted 20 May, 2019;
originally announced May 2019.
