-
Adversarial purification for no-reference image-quality metrics: applicability study and new methods
Authors:
Aleksandr Gushchin,
Anna Chistyakova,
Vladislav Minashkin,
Anastasia Antsiferova,
Dmitriy Vatolin
Abstract:
Recently, the area of adversarial attacks on image quality metrics has begun to be explored, whereas the area of defences remains under-researched. In this study, we aim to cover that case and check the transferability of adversarial purification defences from image classifiers to IQA methods. In this paper, we apply several widespread attacks on IQA models and examine the success of the defences…
▽ More
Recently, the area of adversarial attacks on image quality metrics has begun to be explored, whereas the area of defences remains under-researched. In this study, we aim to cover that case and check the transferability of adversarial purification defences from image classifiers to IQA methods. In this paper, we apply several widespread attacks on IQA models and examine the success of the defences against them. The purification methodologies covered different preprocessing techniques, including geometrical transformations, compression, denoising, and modern neural network-based methods. Also, we address the challenge of assessing the efficacy of a defensive methodology by proposing ways to estimate output visual quality and the success of neutralizing attacks. Defences were tested against attack on three IQA metrics -- Linearity, MetaIQA and SPAQ. The code for attacks and defences is available at: (link is hidden for a blind review).
△ Less
Submitted 10 April, 2024;
originally announced April 2024.
-
Comparing the Robustness of Modern No-Reference Image- and Video-Quality Metrics to Adversarial Attacks
Authors:
Anastasia Antsiferova,
Khaled Abud,
Aleksandr Gushchin,
Ekaterina Shumitskaya,
Sergey Lavrushkin,
Dmitriy Vatolin
Abstract:
Nowadays, neural-network-based image- and video-quality metrics perform better than traditional methods. However, they also became more vulnerable to adversarial attacks that increase metrics' scores without improving visual quality. The existing benchmarks of quality metrics compare their performance in terms of correlation with subjective quality and calculation time. Nonetheless, the adversaria…
▽ More
Nowadays, neural-network-based image- and video-quality metrics perform better than traditional methods. However, they also became more vulnerable to adversarial attacks that increase metrics' scores without improving visual quality. The existing benchmarks of quality metrics compare their performance in terms of correlation with subjective quality and calculation time. Nonetheless, the adversarial robustness of image-quality metrics is also an area worth researching. This paper analyses modern metrics' robustness to different adversarial attacks. We adapted adversarial attacks from computer vision tasks and compared attacks' efficiency against 15 no-reference image- and video-quality metrics. Some metrics showed high resistance to adversarial attacks, which makes their usage in benchmarks safer than vulnerable metrics. The benchmark accepts submissions of new metrics for researchers who want to make their metrics more robust to attacks or to find such metrics for their needs. The latest results can be found online: https://videoprocessing.ai/benchmarks/metrics-robustness.html.
△ Less
Submitted 27 February, 2024; v1 submitted 10 October, 2023;
originally announced October 2023.
-
Video compression dataset and benchmark of learning-based video-quality metrics
Authors:
Anastasia Antsiferova,
Sergey Lavrushkin,
Maksim Smirnov,
Alexander Gushchin,
Dmitriy Vatolin,
Dmitriy Kulikov
Abstract:
Video-quality measurement is a critical task in video processing. Nowadays, many implementations of new encoding standards - such as AV1, VVC, and LCEVC - use deep-learning-based decoding algorithms with perceptual metrics that serve as optimization objectives. But investigations of the performance of modern video- and image-quality metrics commonly employ videos compressed using older standards,…
▽ More
Video-quality measurement is a critical task in video processing. Nowadays, many implementations of new encoding standards - such as AV1, VVC, and LCEVC - use deep-learning-based decoding algorithms with perceptual metrics that serve as optimization objectives. But investigations of the performance of modern video- and image-quality metrics commonly employ videos compressed using older standards, such as AVC. In this paper, we present a new benchmark for video-quality metrics that evaluates video compression. It is based on a new dataset consisting of about 2,500 streams encoded using different standards, including AVC, HEVC, AV1, VP9, and VVC. Subjective scores were collected using crowdsourced pairwise comparisons. The list of evaluated metrics includes recent ones based on machine learning and neural networks. The results demonstrate that new no-reference metrics exhibit a high correlation with subjective quality and approach the capability of top full-reference metrics.
△ Less
Submitted 7 February, 2023; v1 submitted 22 November, 2022;
originally announced November 2022.
-
Shot boundary detection method based on a new extensive dataset and mixed features
Authors:
Alexander Gushchin,
Anastasia Antsiferova,
Dmitriy Vatolin
Abstract:
Shot boundary detection in video is one of the key stages of video data processing. A new method for shot boundary detection based on several video features, such as color histograms and object boundaries, has been proposed. The developed algorithm was tested on the open BBC Planet Earth [1] and RAI [2] datasets, and the MSU CC datasets, based on videos used in the video codec comparison conducted…
▽ More
Shot boundary detection in video is one of the key stages of video data processing. A new method for shot boundary detection based on several video features, such as color histograms and object boundaries, has been proposed. The developed algorithm was tested on the open BBC Planet Earth [1] and RAI [2] datasets, and the MSU CC datasets, based on videos used in the video codec comparison conducted at MSU, as well as videos from the IBM set, were also plotted. The total dataset for algorithm development and testing exceeded the known TRECVID datasets. Based on the test results, the proposed algorithm for scene change detection outperformed its counterparts with a final F-score of 0.9794.
△ Less
Submitted 2 September, 2021;
originally announced September 2021.
-
Single jump filtrations and local martingales
Authors:
Alexander A. Gushchin
Abstract:
A single jump filtration $({\mathscr{F}}_t)_{t\in \mathbb{R}_+}$ generated by a random variable $γ$ with values in $\overline{\mathbb{R}}_+$ on a probability space $(Ω,{\mathscr{F}},\mathsf{P})$ is defined as follows: a set $A\in {\mathscr{F}}$ belongs to ${\mathscr{F}}_t$ if $A\cap \{γ>t\}$ is either $\varnothing$ or $\{γ>t\}$. A process $M$ is proved to be a local martingale with respect to this…
▽ More
A single jump filtration $({\mathscr{F}}_t)_{t\in \mathbb{R}_+}$ generated by a random variable $γ$ with values in $\overline{\mathbb{R}}_+$ on a probability space $(Ω,{\mathscr{F}},\mathsf{P})$ is defined as follows: a set $A\in {\mathscr{F}}$ belongs to ${\mathscr{F}}_t$ if $A\cap \{γ>t\}$ is either $\varnothing$ or $\{γ>t\}$. A process $M$ is proved to be a local martingale with respect to this filtration if and only if it has a representation $M_t=F(t){\mathbb{1}}_{\{t<γ\}}+L{\mathbb{1}}_{\{t\geqslant γ\}}$, where $F$ is a deterministic function and $L$ is a random variable such that $\mathsf{E}|M_t|<\infty$ and $\mathsf{E}(M_t)=\mathsf{E}(M_0)$ for every $t\in \{t\in \mathbb{R}_+:{\mathsf{P}}(γ\geqslant t)>0\}$. This result seems to be new even in a special case that has been studied in the literature, namely, where ${\mathscr{F}}$ is the smallest $σ$-field with respect to which $γ$ is measurable (and then the filtration is the smallest one with respect to which $γ$ is a stop** time). As a consequence, a full description of all local martingales is given and they are classified according to their global behaviour.
△ Less
Submitted 26 June, 2020;
originally announced June 2020.
-
Drift Estimation for a Lévy-Driven Ornstein-Uhlenbeck Process with Heavy Tails
Authors:
Alexander Gushchin,
Ilya Pavlyukevich,
Marian Ritsch
Abstract:
We consider the problem of estimation of the drift parameter of an ergodic Ornstein--Uhlenbeck type process driven by a Lévy process with heavy tails. The process is observed continuously on a long time interval $[0,T]$, $T\to\infty$. We prove that the statistical model is locally asymptotic mixed normal and the maximum likelihood estimator is asymptotically efficient.
We consider the problem of estimation of the drift parameter of an ergodic Ornstein--Uhlenbeck type process driven by a Lévy process with heavy tails. The process is observed continuously on a long time interval $[0,T]$, $T\to\infty$. We prove that the statistical model is locally asymptotic mixed normal and the maximum likelihood estimator is asymptotically efficient.
△ Less
Submitted 25 November, 2019;
originally announced November 2019.
-
Integrated quantile functions: properties and applications
Authors:
Alexander A. Gushchin,
Dmitriy A. Borzykh
Abstract:
In this paper we provide a systematic exposition of basic properties of integrated distribution and quantile functions. We define these transforms in such a way that they characterize any probability distribution on the real line and are Fenchel conjugates of each other. We show that uniform integrability, weak convergence and tightness admit a convenient characterization in terms of integrated qu…
▽ More
In this paper we provide a systematic exposition of basic properties of integrated distribution and quantile functions. We define these transforms in such a way that they characterize any probability distribution on the real line and are Fenchel conjugates of each other. We show that uniform integrability, weak convergence and tightness admit a convenient characterization in terms of integrated quantile functions. As an application we demonstrate how some basic results of the theory of comparison of binary statistical experiments can be deduced using integrated quantile functions. Finally, we extend the area of application of the Chacon--Walsh construction in the Skorokhod embedding problem.
△ Less
Submitted 3 January, 2018;
originally announced January 2018.
-
Phase-coupled Oscillators with Plastic Coupling: Synchronization and Stability
Authors:
Andrey Gushchin,
Enrique Mallada,
Ao Tang
Abstract:
In this article we study synchronization of systems of homogeneous phase-coupled oscillators with plastic coupling strengths and arbitrary underlying topology. The dynamics of the coupling strength between two oscillators is governed by the phase difference between these oscillators. We show that, under mild assumptions, such systems are gradient systems, and always achieve frequency synchronizati…
▽ More
In this article we study synchronization of systems of homogeneous phase-coupled oscillators with plastic coupling strengths and arbitrary underlying topology. The dynamics of the coupling strength between two oscillators is governed by the phase difference between these oscillators. We show that, under mild assumptions, such systems are gradient systems, and always achieve frequency synchronization. Furthermore, we provide sufficient stability and instability conditions that are based on results from algebraic graph theory. For a special case when underlying topology is a tree, we formulate a criterion (necessary and sufficient condition) of stability of equilibria. For both, tree and arbitrary topologies, we provide sufficient conditions for phase-locking, i.e. convergence to a stable equilibrium almost surely. We additionally find conditions when the system possesses a unique stable equilibrium, and thus, almost global stability follows. Several examples are used to demonstrate variety of equilibria the system has, their dependence on system's parameters, and to illustrate differences in behavior of systems with constant and plastic coupling strengths.
△ Less
Submitted 22 February, 2016;
originally announced February 2016.
-
Scalable Routing in SDN-enabled Networks with Consolidated Middleboxes
Authors:
Andrey Gushchin,
Anwar Walid,
Ao Tang
Abstract:
Middleboxes are special network devices that perform various functions such as enabling security and efficiency. SDN-based routing approaches in networks with middleboxes need to address resource constraints, such as memory in the switches and processing power of middleboxes, and traversal constraint where a flow must visit the required middleboxes in a specific order. In this work we propose a so…
▽ More
Middleboxes are special network devices that perform various functions such as enabling security and efficiency. SDN-based routing approaches in networks with middleboxes need to address resource constraints, such as memory in the switches and processing power of middleboxes, and traversal constraint where a flow must visit the required middleboxes in a specific order. In this work we propose a solution based on MultiPoint-To-Point Trees (MPTPT) for routing traffic in SDN-enabled networks with consolidated middleboxes. We show both theoretically and via simulations that our solution significantly reduces the number of routing rules in the switches, while guaranteeing optimum throughput and meeting processing requirements. Additionally, the underlying algorithm has low complexity making it suitable in dynamic network environment.
△ Less
Submitted 7 April, 2015;
originally announced April 2015.
-
Synchronization of Heterogeneous Kuramoto Oscillators with Graphs of Diameter Two
Authors:
Andrey Gushchin,
Enrique Mallada,
Ao Tang
Abstract:
In this article we study synchronization of Kuramoto oscillators with heterogeneous frequencies, and where underlying topology is a graph of diameter two. When the coupling strengths between every two connected oscillators are the same, we find an analytic condition that guarantees an existence of a Positively Invariant Set (PIS) and demonstrate that existence of a PIS suffices for frequency synch…
▽ More
In this article we study synchronization of Kuramoto oscillators with heterogeneous frequencies, and where underlying topology is a graph of diameter two. When the coupling strengths between every two connected oscillators are the same, we find an analytic condition that guarantees an existence of a Positively Invariant Set (PIS) and demonstrate that existence of a PIS suffices for frequency synchronization. For graphs of diameter two, this synchronization condition is significantly better than existing general conditions for an arbitrary topology. If the coupling strengths can be different for different pairs of connected oscillators, we formulate an optimization problem that finds sufficient for synchronization coupling strengths such that their sum is minimal.
△ Less
Submitted 21 February, 2015;
originally announced February 2015.
-
On pathwise counterparts of Doob's maximal inequalities
Authors:
Alexander A. Gushchin
Abstract:
In this paper, we present pathwise counterparts of Doob's maximal inequalities (on the probability of exceeding a level) for submartingales and supermartingales.
In this paper, we present pathwise counterparts of Doob's maximal inequalities (on the probability of exceeding a level) for submartingales and supermartingales.
△ Less
Submitted 30 October, 2014;
originally announced October 2014.
-
Synchronization of Heterogeneous Kuramoto Oscillators with Arbitrary Topology
Authors:
Andrey Gushchin,
Enrique Mallada,
Ao Tang
Abstract:
We study synchronization of coupled Kuramoto oscillators with heterogeneous inherent frequencies and general underlying connectivity. We provide conditions on the coupling strength and the initial phases which guarantee the existence of a Positively Invariant Set (PIS) and lead to synchronization. Unlike previous works that focus only on analytical bounds, here we introduce an optimization approac…
▽ More
We study synchronization of coupled Kuramoto oscillators with heterogeneous inherent frequencies and general underlying connectivity. We provide conditions on the coupling strength and the initial phases which guarantee the existence of a Positively Invariant Set (PIS) and lead to synchronization. Unlike previous works that focus only on analytical bounds, here we introduce an optimization approach to provide a computational-analytical bound that can further exploit the particular features of each individual system such as topology and frequency distribution. Examples are provided to illustrate our results as well as the improvement over previous existing bounds.
△ Less
Submitted 27 October, 2014;
originally announced October 2014.
-
Processes that can be embedded in a geometric Brownian motion
Authors:
Alexander Gushchin,
Mikhail Urusov
Abstract:
The main result is a counterpart of the theorem of Monroe [\emph{Ann. Probability} \textbf{6} (1978) 42--56] for a geometric Brownian motion: A process is equivalent to a time change of a geometric Brownian motion if and only if it is a nonnegative supermartingale. We also provide a link between our main result and Monroe [\emph{Ann. Math. Statist.} \textbf{43} (1972) 1293--1311]. This is based on…
▽ More
The main result is a counterpart of the theorem of Monroe [\emph{Ann. Probability} \textbf{6} (1978) 42--56] for a geometric Brownian motion: A process is equivalent to a time change of a geometric Brownian motion if and only if it is a nonnegative supermartingale. We also provide a link between our main result and Monroe [\emph{Ann. Math. Statist.} \textbf{43} (1972) 1293--1311]. This is based on the concept of a \emph{minimal} stop** time, which is characterised in Monroe [\emph{Ann. Math. Statist.} \textbf{43} (1972) 1293--1311] and Cox and Hobson [\emph{Probab. Theory Related Fields} \textbf{135} (2006) 395--414] in the Brownian case. We finally suggest a sufficient condition for minimality (for the processes other than a Brownian motion) complementing the discussion in the aforementioned papers.
△ Less
Submitted 26 May, 2014; v1 submitted 4 October, 2013;
originally announced October 2013.
