From Forest to Zoo: Great Ape Behavior Recognition with ChimpBehave
Authors:
Michael Fuchs,
Emilie Genty,
Adrian Bangerter,
Klaus Zuberbühler,
Paul Cotofrei
Abstract:
This paper addresses the significant challenge of recognizing behaviors in non-human primates, specifically focusing on chimpanzees. Automated behavior recognition is crucial for both conservation efforts and the advancement of behavioral research. However, it is significantly hindered by the labor-intensive process of manual video annotation. Despite the availability of large-scale animal behavio…
▽ More
This paper addresses the significant challenge of recognizing behaviors in non-human primates, specifically focusing on chimpanzees. Automated behavior recognition is crucial for both conservation efforts and the advancement of behavioral research. However, it is significantly hindered by the labor-intensive process of manual video annotation. Despite the availability of large-scale animal behavior datasets, the effective application of machine learning models across varied environmental settings poses a critical challenge, primarily due to the variability in data collection contexts and the specificity of annotations.
In this paper, we introduce ChimpBehave, a novel dataset featuring over 2 hours of video (approximately 193,000 video frames) of zoo-housed chimpanzees, meticulously annotated with bounding boxes and behavior labels for action recognition. ChimpBehave uniquely aligns its behavior classes with existing datasets, allowing for the study of domain adaptation and cross-dataset generalization methods between different visual settings. Furthermore, we benchmark our dataset using a state-of-the-art CNN-based action recognition model, providing the first baseline results for both within and cross-dataset settings. The dataset, models, and code can be accessed at: https://github.com/MitchFuchs/ChimpBehave
△ Less
Submitted 30 May, 2024;
originally announced May 2024.
PanAf20K: A Large Video Dataset for Wild Ape Detection and Behaviour Recognition
Authors:
Otto Brookes,
Majid Mirmehdi,
Colleen Stephens,
Samuel Angedakin,
Katherine Corogenes,
Dervla Dowd,
Paula Dieguez,
Thurston C. Hicks,
Sorrel Jones,
Kevin Lee,
Vera Leinert,
Juan Lapuente,
Maureen S. McCarthy,
Amelia Meier,
Mizuki Murai,
Emmanuelle Normand,
Virginie Vergnes,
Erin G. Wessling,
Roman M. Wittig,
Kevin Langergraber,
Nuria Maldonado,
Xinyu Yang,
Klaus Zuberbuhler,
Christophe Boesch,
Mimi Arandjelovic
, et al. (2 additional authors not shown)
Abstract:
We present the PanAf20K dataset, the largest and most diverse open-access annotated video dataset of great apes in their natural environment. It comprises more than 7 million frames across ~20,000 camera trap videos of chimpanzees and gorillas collected at 14 field sites in tropical Africa as part of the Pan African Programme: The Cultured Chimpanzee. The footage is accompanied by a rich set of an…
▽ More
We present the PanAf20K dataset, the largest and most diverse open-access annotated video dataset of great apes in their natural environment. It comprises more than 7 million frames across ~20,000 camera trap videos of chimpanzees and gorillas collected at 14 field sites in tropical Africa as part of the Pan African Programme: The Cultured Chimpanzee. The footage is accompanied by a rich set of annotations and benchmarks making it suitable for training and testing a variety of challenging and ecologically important computer vision tasks including ape detection and behaviour recognition. Furthering AI analysis of camera trap information is critical given the International Union for Conservation of Nature now lists all species in the great ape family as either Endangered or Critically Endangered. We hope the dataset can form a solid basis for engagement of the AI community to improve performance, efficiency, and result interpretation in order to support assessments of great ape presence, abundance, distribution, and behaviour and thereby aid conservation efforts.
△ Less
Submitted 31 January, 2024; v1 submitted 24 January, 2024;
originally announced January 2024.
