-
The Making and Breaking of Camouflage
Authors:
Hala Lamdouar,
Weidi Xie,
Andrew Zisserman
Abstract:
Not all camouflages are equally effective, as even a partially visible contour or a slight color difference can make the animal stand out and break its camouflage. In this paper, we address the question of what makes a camouflage successful, by proposing three scores for automatically assessing its effectiveness. In particular, we show that camouflage can be measured by the similarity between back…
▽ More
Not all camouflages are equally effective, as even a partially visible contour or a slight color difference can make the animal stand out and break its camouflage. In this paper, we address the question of what makes a camouflage successful, by proposing three scores for automatically assessing its effectiveness. In particular, we show that camouflage can be measured by the similarity between background and foreground features and boundary visibility. We use these camouflage scores to assess and compare all available camouflage datasets. We also incorporate the proposed camouflage score into a generative model as an auxiliary loss and show that effective camouflage images or videos can be synthesised in a scalable manner. The generated synthetic dataset is used to train a transformer-based model for segmenting camouflaged animals in videos. Experimentally, we demonstrate state-of-the-art camouflage breaking performance on the public MoCA-Mask benchmark.
△ Less
Submitted 7 September, 2023;
originally announced September 2023.
-
Deep-SWIM: A few-shot learning approach to classify Solar WInd Magnetic field structures
Authors:
Hala Lamdouar,
Sairam Sundaresan,
Anna Jungbluth,
Sudeshna Boro Saikia,
Amanda Joy Camarata,
Nathan Miles,
Marcella Scoczynski,
Mavis Stone,
Anthony Sarah,
Andrés Muñoz-Jaramillo,
Ayris Narock,
Adam Szabo
Abstract:
The solar wind consists of charged particles ejected from the Sun into interplanetary space and towards Earth. Understanding the magnetic field of the solar wind is crucial for predicting future space weather and planetary atmospheric loss. Compared to large-scale magnetic events, smaller-scale structures like magnetic discontinuities are hard to detect but entail important information on the evol…
▽ More
The solar wind consists of charged particles ejected from the Sun into interplanetary space and towards Earth. Understanding the magnetic field of the solar wind is crucial for predicting future space weather and planetary atmospheric loss. Compared to large-scale magnetic events, smaller-scale structures like magnetic discontinuities are hard to detect but entail important information on the evolution of the solar wind. A lack of labeled data makes an automated detection of these discontinuities challenging. We propose Deep-SWIM, an approach leveraging advances in contrastive learning, pseudo-labeling and online hard example mining to robustly identify discontinuities in solar wind magnetic field data. Through a systematic ablation study, we show that we can accurately classify discontinuities despite learning from only limited labeled data. Additionally, we show that our approach generalizes well and produces results that agree with expert hand-labeling.
△ Less
Submitted 2 March, 2022;
originally announced March 2022.
-
Self-supervised Video Object Segmentation by Motion Grou**
Authors:
Charig Yang,
Hala Lamdouar,
Erika Lu,
Andrew Zisserman,
Weidi Xie
Abstract:
Animals have evolved highly functional visual systems to understand motion, assisting perception even under complex environments. In this paper, we work towards develo** a computer vision system able to segment objects by exploiting motion cues, i.e. motion segmentation. We make the following contributions: First, we introduce a simple variant of the Transformer to segment optical flow frames in…
▽ More
Animals have evolved highly functional visual systems to understand motion, assisting perception even under complex environments. In this paper, we work towards develo** a computer vision system able to segment objects by exploiting motion cues, i.e. motion segmentation. We make the following contributions: First, we introduce a simple variant of the Transformer to segment optical flow frames into primary objects and the background. Second, we train the architecture in a self-supervised manner, i.e. without using any manual annotations. Third, we analyze several critical components of our method and conduct thorough ablation studies to validate their necessity. Fourth, we evaluate the proposed architecture on public benchmarks (DAVIS2016, SegTrackv2, and FBMS59). Despite using only optical flow as input, our approach achieves superior or comparable results to previous state-of-the-art self-supervised methods, while being an order of magnitude faster. We additionally evaluate on a challenging camouflage dataset (MoCA), significantly outperforming the other self-supervised approaches, and comparing favourably to the top supervised approach, highlighting the importance of motion cues, and the potential bias towards visual appearance in existing video segmentation models.
△ Less
Submitted 11 August, 2021; v1 submitted 15 April, 2021;
originally announced April 2021.
-
Betrayed by Motion: Camouflaged Object Discovery via Motion Segmentation
Authors:
Hala Lamdouar,
Charig Yang,
Weidi Xie,
Andrew Zisserman
Abstract:
The objective of this paper is to design a computational architecture that discovers camouflaged objects in videos, specifically by exploiting motion information to perform object segmentation. We make the following three contributions: (i) We propose a novel architecture that consists of two essential components for breaking camouflage, namely, a differentiable registration module to align consec…
▽ More
The objective of this paper is to design a computational architecture that discovers camouflaged objects in videos, specifically by exploiting motion information to perform object segmentation. We make the following three contributions: (i) We propose a novel architecture that consists of two essential components for breaking camouflage, namely, a differentiable registration module to align consecutive frames based on the background, which effectively emphasises the object boundary in the difference image, and a motion segmentation module with memory that discovers the moving objects, while maintaining the object permanence even when motion is absent at some point. (ii) We collect the first large-scale Moving Camouflaged Animals (MoCA) video dataset, which consists of over 140 clips across a diverse range of animals (67 categories). (iii) We demonstrate the effectiveness of the proposed model on MoCA, and achieve competitive performance on the unsupervised segmentation protocol on DAVIS2016 by only relying on motion.
△ Less
Submitted 23 November, 2020;
originally announced November 2020.
