Showing 1–38 of 38 results for author: Novikov, G

Features Fusion for Dual-View Mammography Mass Detection

Authors: Arina Varlamova, Valery Belotsky, Grigory Novikov, Anton Konushin, Evgeny Sidorov

Abstract: Detection of malignant lesions on mammography images is extremely important for early breast cancer diagnosis. In clinical practice, images are acquired from two different angles, and radiologists can fully utilize information from both views, simultaneously locating the same lesion. However, for automatic detection approaches such information fusion remains a challenge. In this paper, we propose… ▽ More Detection of malignant lesions on mammography images is extremely important for early breast cancer diagnosis. In clinical practice, images are acquired from two different angles, and radiologists can fully utilize information from both views, simultaneously locating the same lesion. However, for automatic detection approaches such information fusion remains a challenge. In this paper, we propose a new model called MAMM-Net, which allows the processing of both mammography views simultaneously by sharing information not only on an object level, as seen in existing works, but also on a feature level. MAMM-Net's key component is the Fusion Layer, based on deformable attention and designed to increase detection precision while kee** high recall. Our experiments show superior performance on the public DDSM dataset compared to the previous state-of-the-art model, while introducing new helpful features such as lesion annotation on pixel-level and classification of lesions malignancy. △ Less

Submitted 25 April, 2024; originally announced April 2024.

Comments: Accepted at ISBI 2024 (21st IEEE International Symposium on Biomedical Imaging)

Efficient GPT Model Pre-training using Tensor Train Matrix Representation

Authors: Viktoriia Chekalina, Georgii Novikov, Julia Gusak, Ivan Oseledets, Alexander Panchenko

Abstract: Large-scale transformer models have shown remarkable performance in language modelling tasks. However, such models feature billions of parameters, leading to difficulties in their deployment and prohibitive training costs from scratch. To reduce the number of the parameters in the GPT-2 architecture, we replace the matrices of fully-connected layers with the corresponding Tensor Train Matrix~(TTM)… ▽ More Large-scale transformer models have shown remarkable performance in language modelling tasks. However, such models feature billions of parameters, leading to difficulties in their deployment and prohibitive training costs from scratch. To reduce the number of the parameters in the GPT-2 architecture, we replace the matrices of fully-connected layers with the corresponding Tensor Train Matrix~(TTM) structure. Finally, we customize forward and backward operations through the TTM-based layer for simplicity and the stableness of further training. % The resulting GPT-2-based model stores up to 40% fewer parameters, showing the perplexity comparable to the original model. On the downstream tasks, including language understanding and text summarization, the model performs similarly to the original GPT-2 model. The proposed tensorized layers could be used to efficiently pre-training other Transformer models. △ Less

Submitted 5 June, 2023; originally announced June 2023.

Robust Mean Estimation Without Moments for Symmetric Distributions

Authors: Gleb Novikov, David Steurer, Stefan Tiegel

Abstract: We study the problem of robustly estimating the mean or location parameter without moment assumptions. We show that for a large class of symmetric distributions, the same error as in the Gaussian setting can be achieved efficiently. The distributions we study include products of arbitrary symmetric one-dimensional distributions, such as product Cauchy distributions, as well as elliptical distribut… ▽ More We study the problem of robustly estimating the mean or location parameter without moment assumptions. We show that for a large class of symmetric distributions, the same error as in the Gaussian setting can be achieved efficiently. The distributions we study include products of arbitrary symmetric one-dimensional distributions, such as product Cauchy distributions, as well as elliptical distributions. For product distributions and elliptical distributions with known scatter (covariance) matrix, we show that given an $\varepsilon$-corrupted sample, we can with probability at least $1-δ$ estimate its location up to error $O(\varepsilon \sqrt{\log(1/\varepsilon)})$ using $\tfrac{d\log(d) + \log(1/δ)}{\varepsilon^2 \log(1/\varepsilon)}$ samples. This result matches the best-known guarantees for the Gaussian distribution and known SQ lower bounds (up to the $\log(d)$ factor). For elliptical distributions with unknown scatter (covariance) matrix, we propose a sequence of efficient algorithms that approaches this optimal error. Specifically, for every $k \in \mathbb{N}$, we design an estimator using time and samples $\tilde{O}({d^k})$ achieving error $O(\varepsilon^{1-\frac{1}{2k}})$. This matches the error and running time guarantees when assuming certifiably bounded moments of order up to $k$. For unknown covariance, such error bounds of $o(\sqrt{\varepsilon})$ are not even known for (general) sub-Gaussian distributions. Our algorithms are based on a generalization of the well-known filtering technique. We show how this machinery can be combined with Huber-loss-based techniques to work with projections of the noise that behave more nicely than the initial noise. Moreover, we show how SoS proofs can be used to obtain algorithmic guarantees even for distributions without a first moment. We believe that this approach may find other applications in future works. △ Less

Submitted 8 November, 2023; v1 submitted 21 February, 2023; originally announced February 2023.

Comments: Accepted at NeurIPS 2023

Sparse PCA Beyond Covariance Thresholding

Authors: Gleb Novikov

Abstract: In the Wishart model for sparse PCA we are given $n$ samples $Y_1,\ldots, Y_n$ drawn independently from a $d$-dimensional Gaussian distribution $N({0, Id + βvv^\top})$, where $β> 0$ and $v\in \mathbb{R}^d$ is a $k$-sparse unit vector, and we wish to recover $v$ (up to sign). We show that if $n \ge Ω(d)$, then for every $t \ll k$ there exists an algorithm running in time $n\cdot d^{O(t)}$ that so… ▽ More In the Wishart model for sparse PCA we are given $n$ samples $Y_1,\ldots, Y_n$ drawn independently from a $d$-dimensional Gaussian distribution $N({0, Id + βvv^\top})$, where $β> 0$ and $v\in \mathbb{R}^d$ is a $k$-sparse unit vector, and we wish to recover $v$ (up to sign). We show that if $n \ge Ω(d)$, then for every $t \ll k$ there exists an algorithm running in time $n\cdot d^{O(t)}$ that solves this problem as long as \[ β\gtrsim \frac{k}{\sqrt{nt}}\sqrt{\ln({2 + td/k^2})}\,. \] Prior to this work, the best polynomial time algorithm in the regime $k\approx \sqrt{d}$, called \emph{Covariance Thresholding} (proposed in [KNV15a] and analyzed in [DM14]), required $β\gtrsim \frac{k}{\sqrt{n}}\sqrt{\ln({2 + d/k^2})}$. For large enough constant $t$ our algorithm runs in polynomial time and has better guarantees than Covariance Thresholding. Previously known algorithms with such guarantees required quasi-polynomial time $d^{O(\log d)}$. In addition, we show that our techniques work with sparse PCA with adversarial perturbations studied in [dKNS20]. This model generalizes not only sparse PCA, but also other problems studied in prior works, including the sparse planted vector problem. As a consequence, we provide polynomial time algorithms for the sparse planted vector problem that have better guarantees than the state of the art in some regimes. Our approach also works with the Wigner model for sparse PCA. Moreover, we show that it is possible to combine our techniques with recent results on sparse PCA with symmetric heavy-tailed noise [dNNS22]. In particular, in the regime $k \approx \sqrt{d}$ we get the first polynomial time algorithm that works with symmetric heavy-tailed noise, while the algorithm from [dNNS22]. requires quasi-polynomial time in these settings. △ Less

Submitted 8 November, 2023; v1 submitted 20 February, 2023; originally announced February 2023.

Comments: COLT 2023

Higher degree sum-of-squares relaxations robust against oblivious outliers

Authors: Tommaso d'Orsi, Rajai Nasser, Gleb Novikov, David Steurer

Abstract: We consider estimation models of the form $Y=X^*+N$, where $X^*$ is some $m$-dimensional signal we wish to recover, and $N$ is symmetrically distributed noise that may be unbounded in all but a small $α$ fraction of the entries. We introduce a family of algorithms that under mild assumptions recover the signal $X^*$ in all estimation problems for which there exists a sum-of-squares algorithm that… ▽ More We consider estimation models of the form $Y=X^*+N$, where $X^*$ is some $m$-dimensional signal we wish to recover, and $N$ is symmetrically distributed noise that may be unbounded in all but a small $α$ fraction of the entries. We introduce a family of algorithms that under mild assumptions recover the signal $X^*$ in all estimation problems for which there exists a sum-of-squares algorithm that succeeds in recovering the signal $X^*$ when the noise $N$ is Gaussian. This essentially shows that it is enough to design a sum-of-squares algorithm for an estimation problem with Gaussian noise in order to get the algorithm that works with the symmetric noise model. Our framework extends far beyond previous results on symmetric noise models and is even robust to adversarial perturbations. As concrete examples, we investigate two problems for which no efficient algorithms were known to work for heavy-tailed noise: tensor PCA and sparse PCA. For the former, our algorithm recovers the principal component in polynomial time when the signal-to-noise ratio is at least $\tilde{O}(n^{p/4}/α)$, that matches (up to logarithmic factors) current best known algorithmic guarantees for Gaussian noise. For the latter, our algorithm runs in quasipolynomial time and matches the state-of-the-art guarantees for quasipolynomial time algorithms in the case of Gaussian noise. Using a reduction from the planted clique problem, we provide evidence that the quasipolynomial time is likely to be necessary for sparse PCA with symmetric noise. In our proofs we use bounds on the covering numbers of sets of pseudo-expectations, which we obtain by certifying in sum-of-squares upper bounds on the Gaussian complexities of sets of solutions. This approach for bounding the covering numbers of sets of pseudo-expectations may be interesting in its own right and may find other application in future works. △ Less

Submitted 14 November, 2022; originally announced November 2022.

Comments: To appear in SODA 2023

Optimization of Functions Given in the Tensor Train Format

Authors: Andrei Chertkov, Gleb Ryzhakov, Georgii Novikov, Ivan Oseledets

Abstract: Tensor train (TT) format is a common approach for computationally efficient work with multidimensional arrays, vectors, matrices, and discretized functions in a wide range of applications, including computational mathematics and machine learning. In this work, we propose a new algorithm for TT-tensor optimization, which leads to very accurate approximations for the minimum and maximum tensor eleme… ▽ More Tensor train (TT) format is a common approach for computationally efficient work with multidimensional arrays, vectors, matrices, and discretized functions in a wide range of applications, including computational mathematics and machine learning. In this work, we propose a new algorithm for TT-tensor optimization, which leads to very accurate approximations for the minimum and maximum tensor element. The method consists in sequential tensor multiplications of the TT-cores with an intelligent selection of candidates for the optimum. We propose the probabilistic interpretation of the method, and make estimates on its complexity and convergence. We perform extensive numerical experiments with random tensors and various multivariable benchmark functions with the number of input dimensions up to $100$. Our approach generates a solution close to the exact optimum for all model problems, while the running time is no more than $50$ seconds on a regular laptop. △ Less

Submitted 29 September, 2022; originally announced September 2022.

Comments: 16 page, 3 figures, 3 tables

MSC Class: 65D15; 65K10

Laser ablation and fragmentation of Boron in liquids

Authors: K. O. Aiyyzhy, E. V. Barmina, V. V. Voronov, G. A. Shafeev, G. G. Novikov, O. V. Uvarov

Abstract: Nanoparticles of elemental Boron are generated for the first time by laser ablation of a sintered Boron target in liquid isopropanol and subsequent laser fragmentation of the suspension. For this purpose an ytterbium doped fiber laser was used at wavelength of 1060-1070 nm, pulse repetition rate of 20 kHz, and pulse duration of 200 ns. The size of Boron nanoparticles after ablation and fragmentati… ▽ More Nanoparticles of elemental Boron are generated for the first time by laser ablation of a sintered Boron target in liquid isopropanol and subsequent laser fragmentation of the suspension. For this purpose an ytterbium doped fiber laser was used at wavelength of 1060-1070 nm, pulse repetition rate of 20 kHz, and pulse duration of 200 ns. The size of Boron nanoparticles after ablation and fragmentation of the suspension is around 30 nm. Nanoparticles are made mostly of Boron and carbon, some particles have carbon shell. Allotropic composition of nanoparticles differs from that of the initial Boron target. Possible applications are discussed. △ Less

Submitted 21 March, 2022; originally announced March 2022.

Comments: 13 pages, 10 figures

Numerical reconstruction from the Fourier transform on the ball using prolate spheroidal wave functions

Authors: Mikhail Isaev, Roman G. Novikov, Grigory V. Sabinin

Abstract: We implement numerically formulas of [Isaev, Novikov, arXiv:2107.07882] for finding a compactly supported function $v$ on $\mathbb{R}^d$, $d\geq 1$, from its Fourier transform $\mathcal{F} [v]$ given within the ball $B_r$. For the one-dimensional case, these formulas are based on the theory of prolate spheroidal wave functions, which arise, in particular, in the singular value decomposition of the… ▽ More We implement numerically formulas of [Isaev, Novikov, arXiv:2107.07882] for finding a compactly supported function $v$ on $\mathbb{R}^d$, $d\geq 1$, from its Fourier transform $\mathcal{F} [v]$ given within the ball $B_r$. For the one-dimensional case, these formulas are based on the theory of prolate spheroidal wave functions, which arise, in particular, in the singular value decomposition of the aforementioned band-limited Fourier transform for $d = 1$. In multidimensions, these formulas also include inversion of the Radon transform. In particular, we give numerical examples of super-resolution, that is, recovering details beyond the diffraction limit. △ Less

Submitted 24 February, 2022; originally announced February 2022.

MSC Class: 42A38; 35R30; 49K40

Few-Bit Backward: Quantized Gradients of Activation Functions for Memory Footprint Reduction

Authors: Georgii Novikov, Daniel Bershatsky, Julia Gusak, Alex Shonenkov, Denis Dimitrov, Ivan Oseledets

Abstract: Memory footprint is one of the main limiting factors for large neural network training. In backpropagation, one needs to store the input to each operation in the computational graph. Every modern neural network model has quite a few pointwise nonlinearities in its architecture, and such operation induces additional memory costs which -- as we show -- can be significantly reduced by quantization of… ▽ More Memory footprint is one of the main limiting factors for large neural network training. In backpropagation, one needs to store the input to each operation in the computational graph. Every modern neural network model has quite a few pointwise nonlinearities in its architecture, and such operation induces additional memory costs which -- as we show -- can be significantly reduced by quantization of the gradients. We propose a systematic approach to compute optimal quantization of the retained gradients of the pointwise nonlinear functions with only a few bits per each element. We show that such approximation can be achieved by computing optimal piecewise-constant approximation of the derivative of the activation function, which can be done by dynamic programming. The drop-in replacements are implemented for all popular nonlinearities and can be used in any existing pipeline. We confirm the memory reduction and the same convergence on several open benchmarks. △ Less

Submitted 2 February, 2022; v1 submitted 1 February, 2022; originally announced February 2022.

Comments: Submitted

Consistent Estimation for PCA and Sparse Regression with Oblivious Outliers

Authors: Tommaso d'Orsi, Chih-Hung Liu, Rajai Nasser, Gleb Novikov, David Steurer, Stefan Tiegel

Abstract: We develop machinery to design efficiently computable and consistent estimators, achieving estimation error approaching zero as the number of observations grows, when facing an oblivious adversary that may corrupt responses in all but an $α$ fraction of the samples. As concrete examples, we investigate two problems: sparse regression and principal component analysis (PCA). For sparse regression, w… ▽ More We develop machinery to design efficiently computable and consistent estimators, achieving estimation error approaching zero as the number of observations grows, when facing an oblivious adversary that may corrupt responses in all but an $α$ fraction of the samples. As concrete examples, we investigate two problems: sparse regression and principal component analysis (PCA). For sparse regression, we achieve consistency for optimal sample size $n\gtrsim (k\log d)/α^2$ and optimal error rate $O(\sqrt{(k\log d)/(n\cdot α^2)})$ where $n$ is the number of observations, $d$ is the number of dimensions and $k$ is the sparsity of the parameter vector, allowing the fraction of inliers to be inverse-polynomial in the number of samples. Prior to this work, no estimator was known to be consistent when the fraction of inliers $α$ is $o(1/\log \log n)$, even for (non-spherical) Gaussian design matrices. Results holding under weak design assumptions and in the presence of such general noise have only been shown in dense setting (i.e., general linear regression) very recently by d'Orsi et al. [dNS21]. In the context of PCA, we attain optimal error guarantees under broad spikiness assumptions on the parameter matrix (usually used in matrix completion). Previous works could obtain non-trivial guarantees only under the assumptions that the measurement noise corresponding to the inliers is polynomially small in $n$ (e.g., Gaussian with variance $1/n^2$). To devise our estimators, we equip the Huber loss with non-smooth regularizers such as the $\ell_1$ norm or the nuclear norm, and extend d'Orsi et al.'s approach [dNS21] in a novel way to analyze the loss function. Our machinery appears to be easily applicable to a wide range of estimation problems. △ Less

Submitted 4 November, 2021; originally announced November 2021.

Comments: To appear in NeurIPS 2021

Transmission eigenvalues for multipoint scatterers

Authors: P. G. Grinevich, R. G. Novikov

Abstract: We study the transmission eigenvalues for the multipoint scatterers of the Bethe-Peierls-Fermi-Zeldovich-Beresin-Faddeev type in dimensions $d=2$ and $d=3$. We show that for these scatterers: 1) each positive energy $E$ is a transmission eigenvalue (in the strong sense) of infinite multiplicity; 2) each complex $E$ is an interior transmission eigenvalue of infinite multiplicity. The case of dimens… ▽ More We study the transmission eigenvalues for the multipoint scatterers of the Bethe-Peierls-Fermi-Zeldovich-Beresin-Faddeev type in dimensions $d=2$ and $d=3$. We show that for these scatterers: 1) each positive energy $E$ is a transmission eigenvalue (in the strong sense) of infinite multiplicity; 2) each complex $E$ is an interior transmission eigenvalue of infinite multiplicity. The case of dimension $d=1$ is also discussed. △ Less

Submitted 18 August, 2021; originally announced August 2021.

Comments: 12 pages

MSC Class: 35J10; 47A40; 47A75; 81U40

Tensor-Train Density Estimation

Authors: Georgii S. Novikov, Maxim E. Panov, Ivan V. Oseledets

Abstract: Estimation of probability density function from samples is one of the central problems in statistics and machine learning. Modern neural network-based models can learn high dimensional distributions but have problems with hyperparameter selection and are often prone to instabilities during training and inference. We propose a new efficient tensor train-based model for density estimation (TTDE). Su… ▽ More Estimation of probability density function from samples is one of the central problems in statistics and machine learning. Modern neural network-based models can learn high dimensional distributions but have problems with hyperparameter selection and are often prone to instabilities during training and inference. We propose a new efficient tensor train-based model for density estimation (TTDE). Such density parametrization allows exact sampling, calculation of cumulative and marginal density functions, and partition function. It also has very intuitive hyperparameters. We develop an efficient non-adversarial training procedure for TTDE based on the Riemannian optimization. Experimental results demonstrate the competitive performance of the proposed method in density estimation and sampling tasks, while TTDE significantly outperforms competitors in training speed. △ Less

Submitted 25 February, 2022; v1 submitted 30 July, 2021; originally announced August 2021.

Comments: Accepted for the 37th Conference on Uncertainty in Artificial Intelligence (UAI 2021)

ACM Class: G.3

Reconstruction from the Fourier transform on the ball via prolate spheroidal wave functions

Authors: Mikhail Isaev, Roman G. Novikov

Abstract: We give new formulas for finding a compactly supported function $v$ on $\mathbb{R}^d$, $d\geq 1$, from its Fourier transform $\mathcal{F} v$ given within the ball $B_r$. For the one-dimensional case, these formulas are based on the theory of prolate spheroidal wave functions (PSWFs). In multidimensions, well-known results of the Radon transform theory reduce the problem to the one-dimensional case… ▽ More We give new formulas for finding a compactly supported function $v$ on $\mathbb{R}^d$, $d\geq 1$, from its Fourier transform $\mathcal{F} v$ given within the ball $B_r$. For the one-dimensional case, these formulas are based on the theory of prolate spheroidal wave functions (PSWFs). In multidimensions, well-known results of the Radon transform theory reduce the problem to the one-dimensional case. Related results on stability and convergence rates are also given. △ Less

Submitted 16 July, 2021; originally announced July 2021.

MSC Class: 42A38; 35R30; 49K40

Sparse PCA: Algorithms, Adversarial Perturbations and Certificates

Authors: Tommaso d'Orsi, Pravesh K. Kothari, Gleb Novikov, David Steurer

Abstract: We study efficient algorithms for Sparse PCA in standard statistical models (spiked covariance in its Wishart form). Our goal is to achieve optimal recovery guarantees while being resilient to small perturbations. Despite a long history of prior works, including explicit studies of perturbation resilience, the best known algorithmic guarantees for Sparse PCA are fragile and break down under small… ▽ More We study efficient algorithms for Sparse PCA in standard statistical models (spiked covariance in its Wishart form). Our goal is to achieve optimal recovery guarantees while being resilient to small perturbations. Despite a long history of prior works, including explicit studies of perturbation resilience, the best known algorithmic guarantees for Sparse PCA are fragile and break down under small adversarial perturbations. We observe a basic connection between perturbation resilience and \emph{certifying algorithms} that are based on certificates of upper bounds on sparse eigenvalues of random matrices. In contrast to other techniques, such certifying algorithms, including the brute-force maximum likelihood estimator, are automatically robust against small adversarial perturbation. We use this connection to obtain the first polynomial-time algorithms for this problem that are resilient against additive adversarial perturbations by obtaining new efficient certificates for upper bounds on sparse eigenvalues of random matrices. Our algorithms are based either on basic semidefinite programming or on its low-degree sum-of-squares strengthening depending on the parameter regimes. Their guarantees either match or approach the best known guarantees of \emph{fragile} algorithms in terms of sparsity of the unknown vector, number of samples and the ambient dimension. To complement our algorithmic results, we prove rigorous lower bounds matching the gap between fragile and robust polynomial-time algorithms in a natural computational model based on low-degree polynomials (closely related to the pseudo-calibration technique for sum-of-squares lower bounds) that is known to capture the best known guarantees for related statistical estimation problems. The combination of these results provides formal evidence of an inherent price to pay to achieve robustness. △ Less

Submitted 12 November, 2020; originally announced November 2020.

Consistent regression when oblivious outliers overwhelm

Authors: Tommaso d'Orsi, Gleb Novikov, David Steurer

Abstract: We consider a robust linear regression model $y=Xβ^* + η$, where an adversary oblivious to the design $X\in \mathbb{R}^{n\times d}$ may choose $η$ to corrupt all but an $α$ fraction of the observations $y$ in an arbitrary way. Prior to our work, even for Gaussian $X$, no estimator for $β^*$ was known to be consistent in this model except for quadratic sample size $n \gtrsim (d/α)^2$ or for logarit… ▽ More We consider a robust linear regression model $y=Xβ^* + η$, where an adversary oblivious to the design $X\in \mathbb{R}^{n\times d}$ may choose $η$ to corrupt all but an $α$ fraction of the observations $y$ in an arbitrary way. Prior to our work, even for Gaussian $X$, no estimator for $β^*$ was known to be consistent in this model except for quadratic sample size $n \gtrsim (d/α)^2$ or for logarithmic inlier fraction $α\ge 1/\log n$. We show that consistent estimation is possible with nearly linear sample size and inverse-polynomial inlier fraction. Concretely, we show that the Huber loss estimator is consistent for every sample size $n= ω(d/α^2)$ and achieves an error rate of $O(d/α^2n)^{1/2}$. Both bounds are optimal (up to constant factors). Our results extend to designs far beyond the Gaussian case and only require the column span of $X$ to not contain approximately sparse vectors). (similar to the kind of assumption commonly made about the kernel space for compressed sensing). We provide two technically similar proofs. One proof is phrased in terms of strong convexity, extending work of [Tsakonas et al.'14], and particularly short. The other proof highlights a connection between the Huber loss estimator and high-dimensional median computations. In the special case of Gaussian designs, this connection leads us to a strikingly simple algorithm based on computing coordinate-wise medians that achieves optimal guarantees in nearly-linear time, and that can exploit sparsity of $β^*$. The model studied here also captures heavy-tailed noise distributions that may not even have a first moment. △ Less

Submitted 25 May, 2021; v1 submitted 30 September, 2020; originally announced September 2020.

Comments: To appear in ICML 2021

Stability estimates for reconstruction from the Fourier transform on the ball

Authors: Mikhail Isaev, Roman G. Novikov

Abstract: We prove Hölder-logarithmic stability estimates for the problem of finding an integrable function $v$ on $\mathbb{R}^d$ with a super-exponential decay at infinity from its Fourier transform $\mathcal{F} v$ given on the ball $B_r$. These estimates arise from a Hölder-stable extrapolation of $\mathcal{F} v$ from $B_r$ to a larger ball. We also present instability examples showing an optimality of ou… ▽ More We prove Hölder-logarithmic stability estimates for the problem of finding an integrable function $v$ on $\mathbb{R}^d$ with a super-exponential decay at infinity from its Fourier transform $\mathcal{F} v$ given on the ball $B_r$. These estimates arise from a Hölder-stable extrapolation of $\mathcal{F} v$ from $B_r$ to a larger ball. We also present instability examples showing an optimality of our results. △ Less

Submitted 23 July, 2020; originally announced July 2020.

MSC Class: 42A38; 35R30; 49K40

Hölder-logarithmic stability in Fourier synthesis

Authors: Mikhail Isaev, Roman G. Novikov

Abstract: We prove a Hölder-logarithmic stability estimate for the problem of finding a sufficiently regular compactly supported function $v$ on $\mathbb{R}^d$ from its Fourier transform $\mathcal{F} v$ given on $[-r,r]^d$. This estimate relies on a Hölder stable continuation of $\mathcal{F}v$ from $[-r,r]^d$ to a larger domain. The related reconstruction procedures are based on truncated series of Chebyshe… ▽ More We prove a Hölder-logarithmic stability estimate for the problem of finding a sufficiently regular compactly supported function $v$ on $\mathbb{R}^d$ from its Fourier transform $\mathcal{F} v$ given on $[-r,r]^d$. This estimate relies on a Hölder stable continuation of $\mathcal{F}v$ from $[-r,r]^d$ to a larger domain. The related reconstruction procedures are based on truncated series of Chebyshev polynomials. We also give an explicit example showing optimality of our stability estimates. △ Less

Submitted 11 November, 2020; v1 submitted 4 May, 2020; originally announced May 2020.

MSC Class: 42A38; 35R30; 49K40

Creation and annihilation of point-potentials using Moutard-type transform in spectral variable

Authors: P. G. Grinevich, R. G. Novikov

Abstract: We continue to develop the method for creation and annihilation of contour singularities in the $\bar\partial$--spectral data for the two-dimensional Schrödinger equation at fixed energy. Our method is based on the Moutard-type transforms for generalized analytic functions. In this note we show that this approach successfully works for point potentials. We continue to develop the method for creation and annihilation of contour singularities in the $\bar\partial$--spectral data for the two-dimensional Schrödinger equation at fixed energy. Our method is based on the Moutard-type transforms for generalized analytic functions. In this note we show that this approach successfully works for point potentials. △ Less

Submitted 21 November, 2019; originally announced November 2019.

Comments: Latex, 15 pages

MSC Class: 30G20; 37K35; 35J10; 47A40; 81Q05; 81U15

Global uniqueness in a passive inverse problem of helioseismology

Authors: A. D. Agaltsov, T. Hohage, R. G. Novikov

Abstract: We consider the inverse problem of recovering the spherically symmetric sound speed, density and attenuation in the Sun from the observations of the acoustic field randomly excited by turbulent convection. We show that observations at two heights above the photosphere and at two frequencies above the acoustic cutoff frequency uniquely determine the solar parameters. We also present numerical simul… ▽ More We consider the inverse problem of recovering the spherically symmetric sound speed, density and attenuation in the Sun from the observations of the acoustic field randomly excited by turbulent convection. We show that observations at two heights above the photosphere and at two frequencies above the acoustic cutoff frequency uniquely determine the solar parameters. We also present numerical simulations which confirm this theoretical result. △ Less

Submitted 12 July, 2019; originally announced July 2019.

MSC Class: 35R30; 85A15; 35J10; 65N21

Darboux-Moutard transformations and Poincare-Steklov operators

Authors: R. G. Novikov, I. A. Taimanov

Abstract: Formulas relating Poincare-Steklov operators for Schroedinger equations related by Darboux-Moutard transformations are derived. They can be used for testing algorithms of reconstruction of the potential from measurements at the boundary. Formulas relating Poincare-Steklov operators for Schroedinger equations related by Darboux-Moutard transformations are derived. They can be used for testing algorithms of reconstruction of the potential from measurements at the boundary. △ Less

Submitted 9 August, 2018; originally announced August 2018.

Comments: 13 pages

Journal ref: Proc. Steklov Inst. Math. 302 (2018), 315-324

Satellite imagery analysis for operational damage assessment in Emergency situations

Authors: Alexey Trekin, German Novikov, Georgy Potapov, Vladimir Ignatiev, Evgeny Burnaev

Abstract: When major disaster occurs the questions are raised how to estimate the damage in time to support the decision making process and relief efforts by local authorities or humanitarian teams. In this paper we consider the use of Machine Learning and Computer Vision on remote sensing imagery to improve time efficiency of assessment of damaged buildings in disaster affected area. We propose a general w… ▽ More When major disaster occurs the questions are raised how to estimate the damage in time to support the decision making process and relief efforts by local authorities or humanitarian teams. In this paper we consider the use of Machine Learning and Computer Vision on remote sensing imagery to improve time efficiency of assessment of damaged buildings in disaster affected area. We propose a general workflow that can be useful in various disaster management applications, and demonstrate the use of the proposed workflow for the assessment of the damage caused by the wildfires in California in 2017. △ Less

Submitted 19 February, 2018; originally announced March 2018.

Comments: 12 pages, 10 figures

Moutard transform for the conductivity equation

Authors: P. G. Grinevich, R. G. Novikov

Abstract: We construct Darboux-Moutard type transforms for the two-dimensional conductivity equation. This result continues our recent studies of Darboux-Moutard type transforms for generalized analytic functions. In addition, at least, some of the Darboux-Moutard type transforms of the present work admit direct extension to the conductivity equation in multidimensions. Relations to the Schrödinger equation… ▽ More We construct Darboux-Moutard type transforms for the two-dimensional conductivity equation. This result continues our recent studies of Darboux-Moutard type transforms for generalized analytic functions. In addition, at least, some of the Darboux-Moutard type transforms of the present work admit direct extension to the conductivity equation in multidimensions. Relations to the Schrödinger equation at zero energy are also shown. △ Less

Submitted 4 March, 2019; v1 submitted 31 December, 2017; originally announced January 2018.

Comments: LaTeX, 17 pages, some additional materials and references were added

Multipoint scatterers with zero-energy bound states

Authors: P. G. Grinevich, R. G. Novikov

Abstract: We study multipoint scatterers with zero-energy bound states in three dimensions. We present examples of such scatterers with multiple zero eigenvalue or with strong multipole localization of zero-energy bound states. We study multipoint scatterers with zero-energy bound states in three dimensions. We present examples of such scatterers with multiple zero eigenvalue or with strong multipole localization of zero-energy bound states. △ Less

Submitted 19 October, 2016; v1 submitted 7 October, 2016; originally announced October 2016.

Comments: LaTeX, 7 pages, minor corrections

Journal ref: Theoret. and Math. Phys., 2017, v.193, No.2, pp. 1675-1679

Automatic Construction of a Recurrent Neural Network based Classifier for Vehicle Passage Detection

Authors: Evgeny Burnaev, Ivan Koptelov, German Novikov, Timur Khanipov

Abstract: Recurrent Neural Networks (RNNs) are extensively used for time-series modeling and prediction. We propose an approach for automatic construction of a binary classifier based on Long Short-Term Memory RNNs (LSTM-RNNs) for detection of a vehicle passage through a checkpoint. As an input to the classifier we use multidimensional signals of various sensors that are installed on the checkpoint. Obtaine… ▽ More Recurrent Neural Networks (RNNs) are extensively used for time-series modeling and prediction. We propose an approach for automatic construction of a binary classifier based on Long Short-Term Memory RNNs (LSTM-RNNs) for detection of a vehicle passage through a checkpoint. As an input to the classifier we use multidimensional signals of various sensors that are installed on the checkpoint. Obtained results demonstrate that the previous approach to handcrafting a classifier, consisting of a set of deterministic rules, can be successfully replaced by an automatic RNN training on an appropriately labelled data. △ Less

Submitted 26 September, 2016; originally announced September 2016.

Comments: 6 pages, 2 figures, 5 tables

Relations between randomness deficiencies

Authors: Gleb Novikov

Abstract: The notion of random sequence was introduced by Martin-Loef in 1966. At the same time he defined the so-called randomness deficiency function that shows how close are random sequences to non-random (in some natural sense). Other deficiency functions can be obtained from the Levin-Schnorr theorem, that describes randomness in terms of Kolmogorov complexity. The difference between all of these defic… ▽ More The notion of random sequence was introduced by Martin-Loef in 1966. At the same time he defined the so-called randomness deficiency function that shows how close are random sequences to non-random (in some natural sense). Other deficiency functions can be obtained from the Levin-Schnorr theorem, that describes randomness in terms of Kolmogorov complexity. The difference between all of these deficiencies is bounded by a logarithmic term. In this paper we show that the difference between some deficiencies can be as large as possible. △ Less

Submitted 29 August, 2016; originally announced August 2016.

Moutard type transformation for matrix generalized analytic functions and gauge transformations

Authors: R. G. Novikov, I. A. Taimanov

Abstract: A Moutard type transformation for matrix generalized analytic functions is derived. Relations between Moutard type transforms and gauge transformations are demonstrated. A Moutard type transformation for matrix generalized analytic functions is derived. Relations between Moutard type transforms and gauge transformations are demonstrated. △ Less

Submitted 4 January, 2017; v1 submitted 20 July, 2016; originally announced July 2016.

Comments: 3 pages

Journal ref: Russian Math. Surveys 71:5 (2016), 970-972

Moutard transform approach to generalized analytic functions with contour poles

Authors: P. G. Grinevich, R. G. Novikov

Abstract: We continue studies of Moutard-type transforms for the generalized analytic functions started in arXiv:1510.08764, arXiv:1512.00343. In particular, we show that generalized analytic functions with the simplest contour poles can be Moutard transformed to the regular ones, at least, locally. In addition, the later Moutard-type transforms are locally invertible. We continue studies of Moutard-type transforms for the generalized analytic functions started in arXiv:1510.08764, arXiv:1512.00343. In particular, we show that generalized analytic functions with the simplest contour poles can be Moutard transformed to the regular ones, at least, locally. In addition, the later Moutard-type transforms are locally invertible. △ Less

Submitted 30 December, 2015; originally announced December 2015.

Comments: LaTeX, 22 pages

Journal ref: Bulletin des sciences mathématiques, 2016, v. 140, issue 6, pp. 638-656

Generalized analytic functions, Moutard-type transforms and holomorphic maps

Authors: P. G. Grinevich, R. G. Novikov

Abstract: We continue the studies of Moutard-type transform for generalized analytic functions started in our previous paper: arXiv:1510.08764. In particular, we suggest an interpretation of generalized analytic functions as spinor fields and show that in the framework of this approach Moutard-type transforms for the aforementioned functions commute with holomorphic changes of variables. We continue the studies of Moutard-type transform for generalized analytic functions started in our previous paper: arXiv:1510.08764. In particular, we suggest an interpretation of generalized analytic functions as spinor fields and show that in the framework of this approach Moutard-type transforms for the aforementioned functions commute with holomorphic changes of variables. △ Less

Submitted 25 November, 2015; originally announced December 2015.

Comments: LaTeX, 4 pages

Journal ref: Funct. Anal. Appl. 2016, v. 50, Issue 2, pp.150-152

Moutard transform for the generalized analytic functions

Authors: P. G. Grinevich, R. G. Novikov

Abstract: We construct a Moutard-type transform for the generalized analytic functions. The first theorems and the first explicit examples in this connection are given. We construct a Moutard-type transform for the generalized analytic functions. The first theorems and the first explicit examples in this connection are given. △ Less

Submitted 29 October, 2015; originally announced October 2015.

Comments: LaTeX, 15 pages

Journal ref: The Journal of Geometric Analysis, 2016, v. 26, Issue 4, pp 2984-2995

A global Riemann-Hilbert problem for two-dimensional inverse scattering at fixed energy

Authors: Evgeny L. Lakshtanov, Roman G. Novikov, Boris R. Vainberg

Abstract: We develop the Riemann-Hilbert problem approach to inverse scattering for the two-dimensional Schrodinger equation at fixed energy. We obtain global or generic versions of the key results of this approach for the case of positive energy and compactly supported potentials. In particular, we do not assume that the potential is small or that Faddeev scattering solutions do not have singularities (i.e… ▽ More We develop the Riemann-Hilbert problem approach to inverse scattering for the two-dimensional Schrodinger equation at fixed energy. We obtain global or generic versions of the key results of this approach for the case of positive energy and compactly supported potentials. In particular, we do not assume that the potential is small or that Faddeev scattering solutions do not have singularities (i.e. we allow the Faddeev exceptional points to exist). Applications of these results to the Novikov-Veselov equation are also considered. △ Less

Submitted 22 September, 2015; originally announced September 2015.

Journal ref: Rend. Istit. Mat. Univ. Trieste, 48, 1-27, 2016. Special issue in honor of G. Alessandrini's 60th birthday

Two-dimensional von Neumann--Wigner potentials with a multiple positive eigenvalue

Authors: R. G. Novikov, I. A. Taimanov, S. P. Tsarev

Abstract: By the Moutard transformation method we construct two-dimensional Schrodinger operators with real smooth potential decaying at infinity and with a multiple positive eigenvalue. These potentials are rational functions of spatial variables and their sines and cosines. By the Moutard transformation method we construct two-dimensional Schrodinger operators with real smooth potential decaying at infinity and with a multiple positive eigenvalue. These potentials are rational functions of spatial variables and their sines and cosines. △ Less

Submitted 19 July, 2013; originally announced July 2013.

Comments: 4 pages

Journal ref: Functional Anal. Appl. 48:4 (2014), 295-297

The Moutard transformation and two-dimensional multi-point delta-type potentials

Authors: R. G. Novikov, I. A. Taimanov

Abstract: In the framework of the Moutard transformation formalism we find multi-point delta-type potentials of two-dimensional Schrodinger operators and their isospectral deformations on the zero energy level. In particular, these potentials are "reflectionless" in the sense of the Faddeev generalized "scattering" data. In the framework of the Moutard transformation formalism we find multi-point delta-type potentials of two-dimensional Schrodinger operators and their isospectral deformations on the zero energy level. In particular, these potentials are "reflectionless" in the sense of the Faddeev generalized "scattering" data. △ Less

Submitted 18 July, 2013; originally announced July 2013.

Comments: 4 pages

Journal ref: Russian Math. Surveys 68:5 (2013), 957-959

Creation of a homogeneous plasma column by means of hohlraum radiation for ion-stop** measurements

Authors: Steffen Faik, Anna Tauschwitz, Mikhail M. Basko, Joachim A. Maruhn, Olga Rosmej, Tim Rienecker, Vladimir G. Novikov, Alexander S. Grushin

Abstract: In this work, we present the results of two-dimensional radiation-hydrodynamics simulations of a hohlraum target whose outgoing radiation is used to produce a homogeneously ionized carbon plasma for ion-beam stop** measurements. The cylindrical hohlraum with gold walls is heated by a frequency-doubled ($λ_l = 526.5$ $μm$) $1.4$ $ns$ long laser pulse with the total energy of $E_l = 180$ $J$. At t… ▽ More In this work, we present the results of two-dimensional radiation-hydrodynamics simulations of a hohlraum target whose outgoing radiation is used to produce a homogeneously ionized carbon plasma for ion-beam stop** measurements. The cylindrical hohlraum with gold walls is heated by a frequency-doubled ($λ_l = 526.5$ $μm$) $1.4$ $ns$ long laser pulse with the total energy of $E_l = 180$ $J$. At the laser spot, the peak matter and radiation temperatures of, respectively, $T \approx 380$ $eV$ and $T_r \approx 120$ $eV$ are observed. X-rays from the hohlraum heat the attached carbon foam with a mean density of $ρ_C = 2$ $mg/cm^3$ to a temperature of $T \approx 25$ $eV$. The simulation shows that the carbon ionization degree ($Z \approx 3.75$) and its column density stay relatively stable (within variations of about $\pm7\%$) long enough to conduct the ion-stop** measurements. Also, it is found that a special attention should be paid to the shock wave, emerging from the X-ray heated copper support plate, which at later times may significantly distort the carbon column density traversed by the fast ions. △ Less

Submitted 8 February, 2014; v1 submitted 25 April, 2013; originally announced April 2013.

Comments: 12 pages, 12 figures

Journal ref: High Energy Density Physics 10 (2014) 47-55

Faddeev eigenfunctions for multipoint potentials

Authors: P. G. Grinevich, R. G. Novikov

Abstract: We present explicit formulas for the Faddeev eigenfunctions and related generalized scattering data for multipoint potentials in two and three dimensions. For single point potentials in 3D such formulas were obtained in an old unpublished work of L.D. Faddeev. For single point potentials in 2D such formulas were given recently by the authors in arXiv:1110.3157 . We present explicit formulas for the Faddeev eigenfunctions and related generalized scattering data for multipoint potentials in two and three dimensions. For single point potentials in 3D such formulas were obtained in an old unpublished work of L.D. Faddeev. For single point potentials in 2D such formulas were given recently by the authors in arXiv:1110.3157 . △ Less

Submitted 1 November, 2012; originally announced November 2012.

Comments: Latex, 19 pages, 4 figures

1D study of radiation-dominated implosion of a cylindrical tungsten plasma column

Authors: M. M. Basko, P. V. Sasorov, M. Murakami, V. G. Novikov, A. S. Grushin

Abstract: Spectral properties of the x-ray pulses, generated by perfectly uniform cylindrical implosions of tungsten plasma with parameters typical of wire array z-pinches, are investigated under the simplifying assumption that the final stage of the kinetic-to-radiant energy conversion is not affected by the magnetic field. The x-ray emission is shown to be generated within a narrow (sub-micron) radiation-… ▽ More Spectral properties of the x-ray pulses, generated by perfectly uniform cylindrical implosions of tungsten plasma with parameters typical of wire array z-pinches, are investigated under the simplifying assumption that the final stage of the kinetic-to-radiant energy conversion is not affected by the magnetic field. The x-ray emission is shown to be generated within a narrow (sub-micron) radiation-dominated stagnation shock front with a "supercritical" amplitude. The structure of the stagnation shock is investigated by using two independent radiation-hydrodynamics codes, and by constructing an approximate analytical model. The x-ray spectra are calculated for two values of the plasma column mass, 0.3 mg/cm and 6 mg/cm, with a newly developed two-dimensional radiation-hydrodynamics code RALEF-2D. The hard component of the spectrum (with a blackbody-fit temperature of 0.5-0.6 keV for the 6-mg/cm mass) originates from a narrow peak of the electron temperature inside the stagnation shock. The softer main component emerges from an extended halo, where the primary shock radiation is reemitted by colder layers of the imploding plasma. Our calculated x-ray spectrum for the 6-mg/cm tungsten column agrees well with the published Sandia experimental data (Foord et al., 2004, Phys. Rev. Lett., vol. 93, 055002). △ Less

Submitted 26 December, 2011; originally announced December 2011.

Comments: 29 pages, 21 figures; reported at the 8th International Conference on Dense Z-pinches (DZP-2011), Biarritz, France, June 5-9, 2011

Quasielastic neutron scattering by concentrated aqueous "single-nano buckydiamond" dispersion

Authors: N. M. Blagoveshchenskii, A. G. Novikov, E. Osawa, N. N. Rozhkova

Abstract: The diffusion characteristics of stable aqueous dispersion of "single-nano buckydiamond" concentration 80 mg/ml, average particle size 8 nm and pure water as the reference system were investigated by quasielastic neutron scattering. The difference of these spectra were analyzed by two ways. In the first way dispersion water was described as the two-component system, consisted of bulk water and a s… ▽ More The diffusion characteristics of stable aqueous dispersion of "single-nano buckydiamond" concentration 80 mg/ml, average particle size 8 nm and pure water as the reference system were investigated by quasielastic neutron scattering. The difference of these spectra were analyzed by two ways. In the first way dispersion water was described as the two-component system, consisted of bulk water and a small additive having presumably the lorentzian form (Hydration water, HW). This additive is located in the nearest surrounding of nano-diamond particle. The second approach included the direct subtraction of dispersion water and bulk water spectra, properly normalized in the regions of their wings, where the influence of HW can be neglected. For both cases of analysis, the relative fraction HW appeared to be about 3%. HW was found to have diffusive mobility which is retarded as compared to bulk water due to the weakening of the rotational component of diffusion and the increased residence lifetime of molecules. △ Less

Submitted 29 August, 2011; originally announced August 2011.

Comments: 7 pages, 10 figures

Discrete spectrum for n-cell potentials

Authors: Piotr G. Grinevich, Roman G. Novikov

Abstract: We study the scattering problem, the Sturm-Liouville problem and the spectral problem with periodic or skew-periodic boundary conditions for the one-dimensional Schrödinger equation with an $n$-cell (finite periodic) potential. We give explicit upper and lower bounds for the distribution functions of discrete spectrum for these problems. For the scattering problem we give, besides, explicit uppe… ▽ More We study the scattering problem, the Sturm-Liouville problem and the spectral problem with periodic or skew-periodic boundary conditions for the one-dimensional Schrödinger equation with an $n$-cell (finite periodic) potential. We give explicit upper and lower bounds for the distribution functions of discrete spectrum for these problems. For the scattering problem we give, besides, explicit upper and lower bounds for the distribution function of discrete spectrum for the case of potential consisting of $n$ not necessarily identical cells. For the scattering problem some results about transmission resonances are obtained. △ Less

Submitted 16 November, 1998; originally announced November 1998.

Comments: 25 pages, LaTeX209 or LaTeX2e

Report number: 98/10-2 MSC Class: 34L15 (Primary) 34L24; 34B24 (Secondary)

Transparent Potentials at Fixed Energy in Dimension Two. Fixed-Energy Dispersion Relations for the Fast Decaying Potentials

Authors: Piotr G. Grinevich, Roman G. Novikov

Abstract: For the two-dimensional Schrödinger equation $$ [- Δ+v(x)]ψ=Eψ,\ x\in \R^2,\ E=E_{fixed}>0 \ \ \ \ \ (*)$$ at a fixed positive energy with a fast decaying at infinity potential $v(x)$ dispersion relations on the scattering data are given.Under "small norm" assumption using these dispersion relations we give (without a complete proof of sufficiency) a characterization of scattering data for the p… ▽ More For the two-dimensional Schrödinger equation $$ [- Δ+v(x)]ψ=Eψ,\ x\in \R^2,\ E=E_{fixed}>0 \ \ \ \ \ (*)$$ at a fixed positive energy with a fast decaying at infinity potential $v(x)$ dispersion relations on the scattering data are given.Under "small norm" assumption using these dispersion relations we give (without a complete proof of sufficiency) a characterization of scattering data for the potentials from the Schwartz class $S=C_{\infty}^{(\infty)} (\hbox{\bf R}^2).$ For the potentials with zero scattering amplitude at a fixed energy $\scriptstyle E_{fixed}$ (transparent potentials) we give a complete proof of this characterization. As a consequence we construct a family (parameterized by a function of one variable) of two-dimensional spherically-symmetric real potentials from the Schwartz class $S$ transparent at a given energy. For the two-dimensional case (without assumption that the potential is small) we show that there are no nonzero real exponentially decreasing at infinity, potentials transparent at a fixed energy. For any dimension greater or equal 1 we prove that there are no nonzero real potentials with zero forward scattering amplitude at an energy interval. We show that KdV-type equations in dimension 2+1 related with the scattering problem $(*)$ (the Novikov-Veselov equations) do not preserve, in general, these dispersion relations starting from the second one. As a corollary these equations do not preserve, in general , the decay rate faster then $|x|^{-3}$ for initial data from the Schwartz class. △ Less

Submitted 28 October, 1994; v1 submitted 26 October, 1994; originally announced October 1994.

Comments: 38 pages, TeX