PanAf20K: A Large Video Dataset for Wild Ape Detection and Behaviour Recognition
Authors:
Otto Brookes,
Majid Mirmehdi,
Colleen Stephens,
Samuel Angedakin,
Katherine Corogenes,
Dervla Dowd,
Paula Dieguez,
Thurston C. Hicks,
Sorrel Jones,
Kevin Lee,
Vera Leinert,
Juan Lapuente,
Maureen S. McCarthy,
Amelia Meier,
Mizuki Murai,
Emmanuelle Normand,
Virginie Vergnes,
Erin G. Wessling,
Roman M. Wittig,
Kevin Langergraber,
Nuria Maldonado,
Xinyu Yang,
Klaus Zuberbuhler,
Christophe Boesch,
Mimi Arandjelovic
, et al. (2 additional authors not shown)
Abstract:
We present the PanAf20K dataset, the largest and most diverse open-access annotated video dataset of great apes in their natural environment. It comprises more than 7 million frames across ~20,000 camera trap videos of chimpanzees and gorillas collected at 14 field sites in tropical Africa as part of the Pan African Programme: The Cultured Chimpanzee. The footage is accompanied by a rich set of an…
▽ More
We present the PanAf20K dataset, the largest and most diverse open-access annotated video dataset of great apes in their natural environment. It comprises more than 7 million frames across ~20,000 camera trap videos of chimpanzees and gorillas collected at 14 field sites in tropical Africa as part of the Pan African Programme: The Cultured Chimpanzee. The footage is accompanied by a rich set of annotations and benchmarks making it suitable for training and testing a variety of challenging and ecologically important computer vision tasks including ape detection and behaviour recognition. Furthering AI analysis of camera trap information is critical given the International Union for Conservation of Nature now lists all species in the great ape family as either Endangered or Critically Endangered. We hope the dataset can form a solid basis for engagement of the AI community to improve performance, efficiency, and result interpretation in order to support assessments of great ape presence, abundance, distribution, and behaviour and thereby aid conservation efforts.
△ Less
Submitted 31 January, 2024; v1 submitted 24 January, 2024;
originally announced January 2024.
Transferring Dense Pose to Proximal Animal Classes
Authors:
Artsiom Sanakoyeu,
Vasil Khalidov,
Maureen S. McCarthy,
Andrea Vedaldi,
Natalia Neverova
Abstract:
Recent contributions have demonstrated that it is possible to recognize the pose of humans densely and accurately given a large dataset of poses annotated in detail. In principle, the same approach could be extended to any animal class, but the effort required for collecting new annotations for each case makes this strategy impractical, despite important applications in natural conservation, scien…
▽ More
Recent contributions have demonstrated that it is possible to recognize the pose of humans densely and accurately given a large dataset of poses annotated in detail. In principle, the same approach could be extended to any animal class, but the effort required for collecting new annotations for each case makes this strategy impractical, despite important applications in natural conservation, science and business. We show that, at least for proximal animal classes such as chimpanzees, it is possible to transfer the knowledge existing in dense pose recognition for humans, as well as in more general object detectors and segmenters, to the problem of dense pose recognition in other classes. We do this by (1) establishing a DensePose model for the new animal which is also geometrically aligned to humans (2) introducing a multi-head R-CNN architecture that facilitates transfer of multiple recognition tasks between classes, (3) finding which combination of known classes can be transferred most effectively to the new animal and (4) using self-calibrated uncertainty heads to generate pseudo-labels graded by quality for training a model for this class. We also introduce two benchmark datasets labelled in the manner of DensePose for the class chimpanzee and use them to evaluate our approach, showing excellent transfer learning performance.
△ Less
Submitted 28 February, 2020;
originally announced March 2020.
