North Atlantic Right Whales Up-call Detection Using Multimodel Deep Learning
Authors:
Ali K Ibrahim,
Hanqi Zhuang,
Laurent M. Ch'erubin,
Nurgun Erdol,
Gregory O Corry-Crowe,
Ali Muhamed Ali
Abstract:
A new method for North Atlantic Right Whales (NARW) up-call detection using Multimodel Deep Learning (MMDL) is presented in this paper. In this approach, signals from passive acoustic sensors are first converted to spectrogram and scalogram images, which are time-frequency representations of the signals. These images are in turn used to train an MMDL detec-tor, consisting of Convolutional Neural N…
▽ More
A new method for North Atlantic Right Whales (NARW) up-call detection using Multimodel Deep Learning (MMDL) is presented in this paper. In this approach, signals from passive acoustic sensors are first converted to spectrogram and scalogram images, which are time-frequency representations of the signals. These images are in turn used to train an MMDL detec-tor, consisting of Convolutional Neural Networks (CNNs) and Stacked Auto Encoders (SAEs). Our experimental studies revealed that CNNs work better with spectrograms and SAEs with sca-lograms. Therefore in our experimental design, the CNNs are trained by using spectrogram im-ages, and the SAEs are trained by using scalogram images. A fusion mechanism is used to fuse the results from individual neural networks. In this paper, the results obtained from the MMDL detector are compared with those obtained from conventional machine learning algorithms trained with handcraft features. It is shown that the performance of the MMDL detector is sig-nificantly better than those of the representative conventional machine learning methods in terms of up-call detection rate, non-up-call detection rate, and false alarm rate.
△ Less
Submitted 17 May, 2020;
originally announced May 2020.
Detection of north atlantic right whale upcalls using local binary patterns in a two-stage strategy
Authors:
Mahdi Esfahanian,
Hanqi Zhuang,
Nurgun Erdol,
Edmund Gerstein
Abstract:
In this paper, we investigate the effectiveness of two-stage classification strategies in detecting north Atlantic right whale upcalls. Time-frequency measurements of data from passive acoustic monitoring devices are evaluated as images. Vocalization spectrograms are preprocessed for noise reduction and tone removal. First stage of the algorithm eliminates non-upcalls by an energy detection algori…
▽ More
In this paper, we investigate the effectiveness of two-stage classification strategies in detecting north Atlantic right whale upcalls. Time-frequency measurements of data from passive acoustic monitoring devices are evaluated as images. Vocalization spectrograms are preprocessed for noise reduction and tone removal. First stage of the algorithm eliminates non-upcalls by an energy detection algorithm. In the second stage, two sets of features are extracted from the remaining signals using contour-based and texture based methods. The former is based on extraction of time-frequency features from upcall contours, and the latter employs a Local Binary Pattern operator to extract distinguishing texture features of the upcalls. Subsequently evaluation phase is carried out by using several classifiers to assess the effectiveness of both the contour-based and texture-based features for upcall detection. Experimental results with the data set provided by the Cornell University Bioacoustics Research Program reveal that classifiers show accuracy improvements of 3% to 4% when using LBP features over time-frequency features. Classifiers such as the Linear Discriminant Analysis, Support Vector Machine, and TreeBagger achieve high upcall detection rates with LBP features.
△ Less
Submitted 15 November, 2016;
originally announced November 2016.
