-
Teaching Computer Vision for Ecology
Authors:
Elijah Cole,
Suzanne Stathatos,
Björn Lütjens,
Tarun Sharma,
Justin Kay,
Jason Parham,
Benjamin Kellenberger,
Sara Beery
Abstract:
Computer vision can accelerate ecology research by automating the analysis of raw imagery from sensors like camera traps, drones, and satellites. However, computer vision is an emerging discipline that is rarely taught to ecologists. This work discusses our experience teaching a diverse group of ecologists to prototype and evaluate computer vision systems in the context of an intensive hands-on su…
▽ More
Computer vision can accelerate ecology research by automating the analysis of raw imagery from sensors like camera traps, drones, and satellites. However, computer vision is an emerging discipline that is rarely taught to ecologists. This work discusses our experience teaching a diverse group of ecologists to prototype and evaluate computer vision systems in the context of an intensive hands-on summer workshop. We explain the workshop structure, discuss common challenges, and propose best practices. This document is intended for computer scientists who teach computer vision across disciplines, but it may also be useful to ecologists or other domain experts who are learning to use computer vision themselves.
△ Less
Submitted 5 January, 2023;
originally announced January 2023.
-
The Animal ID Problem: Continual Curation
Authors:
Charles V. Stewart,
Jason R. Parham,
Jason Holmberg,
Tanya Y. Berger-Wolf
Abstract:
Ho** to stimulate new research in individual animal identification from images, we propose to formulate the problem as the human-machine Continual Curation of images and animal identities. This is an open world recognition problem, where most new animals enter the system after its algorithms are initially trained and deployed. Continual Curation, as defined here, requires (1) an improvement in t…
▽ More
Ho** to stimulate new research in individual animal identification from images, we propose to formulate the problem as the human-machine Continual Curation of images and animal identities. This is an open world recognition problem, where most new animals enter the system after its algorithms are initially trained and deployed. Continual Curation, as defined here, requires (1) an improvement in the effectiveness of current recognition methods, (2) a pairwise verification algorithm that allows the possibility of no decision, and (3) an algorithmic decision mechanism that seeks human input to guide the curation process. Error metrics must evaluate the ability of recognition algorithms to identify not only animals that have been seen just once or twice but also recognize new animals not in the database. An important measure of overall system performance is accuracy as a function of the amount of human input required.
△ Less
Submitted 18 June, 2021;
originally announced June 2021.
-
Wildbook: Crowdsourcing, computer vision, and data science for conservation
Authors:
Tanya Y. Berger-Wolf,
Daniel I. Rubenstein,
Charles V. Stewart,
Jason A. Holmberg,
Jason Parham,
Sreejith Menon,
Jonathan Crall,
Jon Van Oast,
Emre Kiciman,
Lucas Joppa
Abstract:
Photographs, taken by field scientists, tourists, automated cameras, and incidental photographers, are the most abundant source of data on wildlife today. Wildbook is an autonomous computational system that starts from massive collections of images and, by detecting various species of animals and identifying individuals, combined with sophisticated data management, turns them into high resolution…
▽ More
Photographs, taken by field scientists, tourists, automated cameras, and incidental photographers, are the most abundant source of data on wildlife today. Wildbook is an autonomous computational system that starts from massive collections of images and, by detecting various species of animals and identifying individuals, combined with sophisticated data management, turns them into high resolution information database, enabling scientific inquiry, conservation, and citizen science.
We have built Wildbooks for whales (flukebook.org), sharks (whaleshark.org), two species of zebras (Grevy's and plains), and several others. In January 2016, Wildbook enabled the first ever full species (the endangered Grevy's zebra) census using photographs taken by ordinary citizens in Kenya. The resulting numbers are now the official species census used by IUCN Red List: http://www.iucnredlist.org/details/7950/0. In 2016, Wildbook partnered up with WWF to build Wildbook for Sea Turtles, Internet of Turtles (IoT), as well as systems for seals and lynx. Most recently, we have demonstrated that we can now use publicly available social media images to count and track wild animals.
In this paper we present and discuss both the impact and challenges that the use of crowdsourced images can have on wildlife conservation.
△ Less
Submitted 24 October, 2017;
originally announced October 2017.
-
Finding the Force -- Consistent Particle Seeding for Satellite Aerodynamics
Authors:
J. Brent Parham,
L. A. Barba
Abstract:
When calculating satellite trajectories in low-earth orbit, engineers need to adequately estimate aerodynamic forces. But to this day, obtaining the drag acting on the complicated shapes of modern spacecraft suffers from many sources of error. While part of the problem is the uncertain density in the upper atmosphere, this works focuses on improving the modeling of interacting rarified gases and s…
▽ More
When calculating satellite trajectories in low-earth orbit, engineers need to adequately estimate aerodynamic forces. But to this day, obtaining the drag acting on the complicated shapes of modern spacecraft suffers from many sources of error. While part of the problem is the uncertain density in the upper atmosphere, this works focuses on improving the modeling of interacting rarified gases and satellite surfaces. The only numerical approach that currently captures effects in this flow regime---like self-shadowing and multiple molecular reflections---is known as test-particle Monte Carlo. This method executes a ray-tracing algorithm to follow particles that pass through a control volume containing the spacecraft and accumulates the momentum transfer to the body surfaces. Statistical fluctuations inherent in the approach demand particle numbers in the order of millions, often making this scheme too costly to be practical. This work presents a parallel test-particle Monte Carlo method that takes advantage of both GPUs and multi-core CPUs. The speed at which this model can run with millions of particles allowed exploring a regime where a flaw in the model's initial particle seeding was revealed. Our new model introduces an analytical fix based on seeding the calculation with an initial distribution of particles at the boundary of a spherical control volume and computing the integral for the correct number flux. This work includes verification of the proposed model using analytical solutions for several simple geometries and demonstrates uses for studying aero-stabilization of the Phobos-Grunt Martian probe and pose-estimation for the ICESat mission.
△ Less
Submitted 12 December, 2013;
originally announced December 2013.