-
Removing Human Bottlenecks in Bird Classification Using Camera Trap Images and Deep Learning
Authors:
Carl Chalmers,
Paul Fergus,
Serge Wich,
Steven N Longmore,
Naomi Davies Walsh,
Philip Stephens,
Chris Sutherland,
Naomi Matthews,
Jens Mudde,
Amira Nuseibeh
Abstract:
Birds are important indicators for monitoring both biodiversity and habitat health; they also play a crucial role in ecosystem management. Decline in bird populations can result in reduced eco-system services, including seed dispersal, pollination and pest control. Accurate and long-term monitoring of birds to identify species of concern while measuring the success of conservation interventions is…
▽ More
Birds are important indicators for monitoring both biodiversity and habitat health; they also play a crucial role in ecosystem management. Decline in bird populations can result in reduced eco-system services, including seed dispersal, pollination and pest control. Accurate and long-term monitoring of birds to identify species of concern while measuring the success of conservation interventions is essential for ecologists. However, monitoring is time consuming, costly and often difficult to manage over long durations and at meaningfully large spatial scales. Technology such as camera traps, acoustic monitors and drones provide methods for non-invasive monitoring. There are two main problems with using camera traps for monitoring: a) cameras generate many images, making it difficult to process and analyse the data in a timely manner; and b) the high proportion of false positives hinders the processing and analysis for reporting. In this paper, we outline an approach for overcoming these issues by utilising deep learning for real-time classi-fication of bird species and automated removal of false positives in camera trap data. Images are classified in real-time using a Faster-RCNN architecture. Images are transmitted over 3/4G cam-eras and processed using Graphical Processing Units (GPUs) to provide conservationists with key detection metrics therefore removing the requirement for manual observations. Our models achieved an average sensitivity of 88.79%, a specificity of 98.16% and accuracy of 96.71%. This demonstrates the effectiveness of using deep learning for automatic bird monitoring.
△ Less
Submitted 3 May, 2023;
originally announced May 2023.
-
Empowering Wildlife Guardians: An Equitable Digital Stewardship and Reward System for Biodiversity Conservation using Deep Learning and 3/4G Camera Traps
Authors:
Paul Fergus,
Carl Chalmers,
Steven Longmore,
Serge Wich,
Carmen Warmenhove,
Jonathan Swart,
Thuto Ngongwane,
André Burger,
Jonathan Ledgard,
Erik Meijaard
Abstract:
The biodiversity of our planet is under threat, with approximately one million species expected to become extinct within decades. The reason; negative human actions, which include hunting, overfishing, pollution, and the conversion of land for urbanisation and agricultural purposes. Despite significant investment from charities and governments for activities that benefit nature, global wildlife po…
▽ More
The biodiversity of our planet is under threat, with approximately one million species expected to become extinct within decades. The reason; negative human actions, which include hunting, overfishing, pollution, and the conversion of land for urbanisation and agricultural purposes. Despite significant investment from charities and governments for activities that benefit nature, global wildlife populations continue to decline. Local wildlife guardians have historically played a critical role in global conservation efforts and have shown their ability to achieve sustainability at various levels. In 2021, COP26 recognised their contributions and pledged US$1.7 billion per year; however, this is a fraction of the global biodiversity budget available (between US$124 billion and US$143 billion annually) given they protect 80% of the planets biodiversity. This paper proposes a radical new solution based on "Interspecies Money," where animals own their own money. Creating a digital twin for each species allows animals to dispense funds to their guardians for the services they provide. For example, a rhinoceros may release a payment to its guardian each time it is detected in a camera trap as long as it remains alive and well. To test the efficacy of this approach 27 camera traps were deployed over a 400km2 area in Welgevonden Game Reserve in Limpopo Province in South Africa. The motion-triggered camera traps were operational for ten months and, using deep learning, we managed to capture images of 12 distinct animal species. For each species, a makeshift bank account was set up and credited with £100. Each time an animal was captured in a camera and successfully classified, 1 penny (an arbitrary amount - mechanisms still need to be developed to determine the real value of species) was transferred from the animal account to its associated guardian.
△ Less
Submitted 25 April, 2023;
originally announced April 2023.
-
Modelling Animal Biodiversity Using Acoustic Monitoring and Deep Learning
Authors:
C. Chalmers,
P. Fergus,
S. Wich,
S. N. Longmore
Abstract:
For centuries researchers have used sound to monitor and study wildlife. Traditionally, conservationists have identified species by ear; however, it is now common to deploy audio recording technology to monitor animal and ecosystem sounds. Animals use sound for communication, mating, navigation and territorial defence. Animal sounds provide valuable information and help conservationists to quantif…
▽ More
For centuries researchers have used sound to monitor and study wildlife. Traditionally, conservationists have identified species by ear; however, it is now common to deploy audio recording technology to monitor animal and ecosystem sounds. Animals use sound for communication, mating, navigation and territorial defence. Animal sounds provide valuable information and help conservationists to quantify biodiversity. Acoustic monitoring has grown in popularity due to the availability of diverse sensor types which include camera traps, portable acoustic sensors, passive acoustic sensors, and even smartphones. Passive acoustic sensors are easy to deploy and can be left running for long durations to provide insights on habitat and the sounds made by animals and illegal activity. While this technology brings enormous benefits, the amount of data that is generated makes processing a time-consuming process for conservationists. Consequently, there is interest among conservationists to automatically process acoustic data to help speed up biodiversity assessments. Processing these large data sources and extracting relevant sounds from background noise introduces significant challenges. In this paper we outline an approach for achieving this using state of the art in machine learning to automatically extract features from time-series audio signals and modelling deep learning models to classify different bird species based on the sounds they make. The acquired bird songs are processed using mel-frequency cepstrum (MFC) to extract features which are later classified using a multilayer perceptron (MLP). Our proposed method achieved promising results with 0.74 sensitivity, 0.92 specificity and an accuracy of 0.74.
△ Less
Submitted 12 March, 2021;
originally announced March 2021.
-
Conservation AI: Live Stream Analysis for the Detection of Endangered Species Using Convolutional Neural Networks and Drone Technology
Authors:
C. Chalmers,
P. Fergus,
Serge Wich,
Aday Curbelo Montanez
Abstract:
Many different species are adversely affected by poaching. In response to this escalating crisis, efforts to stop poaching using hidden cameras, drones and DNA tracking have been implemented with varying degrees of success. Limited resources, costs and logistical limitations are often the cause of most unsuccessful poaching interventions. The study presented in this paper outlines a flexible and i…
▽ More
Many different species are adversely affected by poaching. In response to this escalating crisis, efforts to stop poaching using hidden cameras, drones and DNA tracking have been implemented with varying degrees of success. Limited resources, costs and logistical limitations are often the cause of most unsuccessful poaching interventions. The study presented in this paper outlines a flexible and interoperable framework for the automatic detection of animals and poaching activity to facilitate early intervention practices. Using a robust deep learning pipeline, a convolutional neural network is trained and implemented to detect rhinos and cars (considered an important tool in poaching for fast access and artefact transportation in natural habitats) in the study, that are found within live video streamed from drones Transfer learning with the Faster RCNN Resnet 101 is performed to train a custom model with 350 images of rhinos and 350 images of cars. Inference is performed using a frame sampling technique to address the required trade-off control precision and processing speed and maintain synchronisation with the live feed. Inference models are hosted on a web platform using flask web serving, OpenCV and TensorFlow 1.13. Video streams are transmitted from a DJI Mavic Pro 2 drone using the Real-Time Messaging Protocol (RMTP). The best trained Faster RCNN model achieved a mAP of 0.83 @IOU 0.50 and 0.69 @IOU 0.75 respectively. In comparison an SSD-mobilenetmodel trained under the same experimental conditions achieved a mAP of 0.55 @IOU .50 and 0.27 @IOU 0.75.The results demonstrate that using a FRCNN and off-the-shelf drones is a promising and scalable option for a range of conservation projects.
△ Less
Submitted 16 October, 2019;
originally announced October 2019.
-
Optimising observing strategies for monitoring animals using drone-mounted thermal infrared cameras
Authors:
Claire Burke,
Maisie Rashman,
Serge Wich,
Andy Symons,
Cobus Theron,
Steve Longmore
Abstract:
The proliferation of relatively affordable off-the-shelf drones offers great opportunities for wildlife monitoring and conservation. Similarly the recent reduction in cost of thermal infrared cameras also offers new promise in this field, as they have the advantage over conventional RGB cameras of being able to distinguish animals based on their body heat and being able to detect animals at night.…
▽ More
The proliferation of relatively affordable off-the-shelf drones offers great opportunities for wildlife monitoring and conservation. Similarly the recent reduction in cost of thermal infrared cameras also offers new promise in this field, as they have the advantage over conventional RGB cameras of being able to distinguish animals based on their body heat and being able to detect animals at night. However, the use of drone-mounted thermal infrared cameras comes with several technical challenges. In this paper we address some of these issues, namely thermal contrast problems due to heat from the ground, absorption and emission of thermal infrared radiation by the atmosphere, obscuration by vegetation, and optimizing the flying height of drones for a best balance between covering a large area and being able to accurately image and identify animals of interest. We demonstrate the application of these methods with a case study using field data, and make the first ever detection of the critically endangered riverine rabbit (Bunolagus monticularis) in thermal infrared data. We provide a web-tool so that the community can easily apply these techniques to other studies (http://www.astro.ljmu.ac.uk/~aricburk/uav_calc/).
△ Less
Submitted 12 November, 2018;
originally announced December 2018.
-
Addressing environmental and atmospheric challenges for capturing high-precision thermal infrared data in the field of astro-ecology
Authors:
Claire Burke,
Maisie F. Rashman,
Owen McAree,
Leonard Hambrecht,
Steve N. Longmore,
Alex K. Piel,
Serge A. Wich
Abstract:
Using thermal infrared detectors mounted on drones, and applying techniques from astrophysics, we hope to support the field of conservation ecology by creating an automated pipeline for the detection and identification of certain endangered species and poachers from thermal infrared data. We test part of our system by attempting to detect simulated poachers in the field. Whilst we find that we can…
▽ More
Using thermal infrared detectors mounted on drones, and applying techniques from astrophysics, we hope to support the field of conservation ecology by creating an automated pipeline for the detection and identification of certain endangered species and poachers from thermal infrared data. We test part of our system by attempting to detect simulated poachers in the field. Whilst we find that we can detect humans hiding in the field in some types of terrain, we also find several environmental factors that prevent accurate detection, such as ambient heat from the ground, absorption of infrared emission by the atmosphere, obscuring vegetation and spurious sources from the terrain. We discuss the effect of these issues, and potential solutions which will be required for our future vision for a fully automated drone-based global conservation monitoring system.
△ Less
Submitted 6 July, 2018;
originally announced July 2018.
-
Adapting astronomical source detection software to help detect animals in thermal images obtained by unmanned aerial systems
Authors:
S. N. Longmore,
R. P. Collins,
S. Pfeifer,
S. E. Fox,
M. Mulero-Pazmany,
F. Bezombes,
A. Goodwind,
M. de Juan Ovelar,
J. H. Knapen,
S. A. Wich
Abstract:
In this paper we describe an unmanned aerial system equipped with a thermal-infrared camera and software pipeline that we have developed to monitor animal populations for conservation purposes. Taking a multi-disciplinary approach to tackle this problem, we use freely available astronomical source detection software and the associated expertise of astronomers, to efficiently and reliably detect hu…
▽ More
In this paper we describe an unmanned aerial system equipped with a thermal-infrared camera and software pipeline that we have developed to monitor animal populations for conservation purposes. Taking a multi-disciplinary approach to tackle this problem, we use freely available astronomical source detection software and the associated expertise of astronomers, to efficiently and reliably detect humans and animals in aerial thermal-infrared footage. Combining this astronomical detection software with existing machine learning algorithms into a single, automated, end-to-end pipeline, we test the software using aerial video footage taken in a controlled, field-like environment. We demonstrate that the pipeline works reliably and describe how it can be used to estimate the completeness of different observational datasets to objects of a given type as a function of height, observing conditions etc. -- a crucial step in converting video footage to scientifically useful information such as the spatial distribution and density of different animal species. Finally, having demonstrated the potential utility of the system, we describe the steps we are taking to adapt the system for work in the field, in particular systematic monitoring of endangered species at National Parks around the world.
△ Less
Submitted 6 January, 2017;
originally announced January 2017.
