Showing 1–1 of 1 results for author: Sokolova, A D

Organizing Multimedia Data in Video Surveillance Systems Based on Face Verification with Convolutional Neural Networks

Authors: Anastasiia D. Sokolova, Angelina S. Kharchevnikova, Andrey V. Savchenko

Abstract: In this paper we propose the two-stage approach of organizing information in video surveillance systems. At first, the faces are detected in each frame and a video stream is split into sequences of frames with face region of one person. Secondly, these sequences (tracks) that contain identical faces are grouped using face verification algorithms and hierarchical agglomerative clustering. Gender an… ▽ More In this paper we propose the two-stage approach of organizing information in video surveillance systems. At first, the faces are detected in each frame and a video stream is split into sequences of frames with face region of one person. Secondly, these sequences (tracks) that contain identical faces are grouped using face verification algorithms and hierarchical agglomerative clustering. Gender and age are estimated for each cluster (person) in order to facilitate the usage of the organized video collection. The particular attention is focused on the aggregation of features extracted from each frame with the deep convolutional neural networks. The experimental results of the proposed approach using YTF and IJB-A datasets demonstrated that the most accurate and fast solution is achieved for matching of normalized average of feature vectors of all frames in a track. △ Less

Submitted 17 September, 2017; originally announced September 2017.

Comments: 8 pages; 1 figure, accepted for publication at AIST17

MSC Class: 68T10; 68T45 ACM Class: I.4.8; I.5.4

Journal ref: Proceedings of the International Conference on Analysis of Images, Social Networks and Texts (AIST), 2018, pp. 223-230