-
On some tensor tubal-Krylov subspace methods via the T-product
Authors:
A. El Ichi,
K. Jbilou,
R. Sadaka
Abstract:
In the present paper, we introduce new tensor Krylov subspace methods for solving linear tensor equations. The proposed methods use the well known T-product for tensors and tensor subspaces related to tube fibers. We introduce some new tensor products and the related algebraic properties. These new products will enable us to develop third-order the tensor tubal GMRES and the tensor tubal Golub Kah…
▽ More
In the present paper, we introduce new tensor Krylov subspace methods for solving linear tensor equations. The proposed methods use the well known T-product for tensors and tensor subspaces related to tube fibers. We introduce some new tensor products and the related algebraic properties. These new products will enable us to develop third-order the tensor tubal GMRES and the tensor tubal Golub Kahan methods. We give some properties related to these methods and proopse some numerical experiments.
△ Less
Submitted 27 February, 2021; v1 submitted 24 October, 2020;
originally announced October 2020.
-
Tensor Krylov subspace methods via the T-product for color image processing
Authors:
M. El Guide,
A. El Ichi,
K. Jbilou,
R. Sadaka
Abstract:
The present paper is concerned with develo** tensor iterative Krylov subspace methods to solve large multi-linear tensor equations. We use the well-known T-product for two tensors to define tensor global Arnoldi and tensor global Gloub-Kahan bidiagonalization algorithms. Furthermore, we illustrate how tensor-based global approaches can be exploited to solve ill-posed problems arising from recove…
▽ More
The present paper is concerned with develo** tensor iterative Krylov subspace methods to solve large multi-linear tensor equations. We use the well-known T-product for two tensors to define tensor global Arnoldi and tensor global Gloub-Kahan bidiagonalization algorithms. Furthermore, we illustrate how tensor-based global approaches can be exploited to solve ill-posed problems arising from recovering blurry multichannel (color) images and videos, using the so-called Tikhonov regularization technique, to provide computable approximate regularized solutions. We also review a generalized cross-validation and discrepancy principle type of criterion for the selection of the regularization parameter in the Tikhonov regularization. Applications to RGB image and video processing are given to demonstrate the efficiency of the algorithms.
△ Less
Submitted 10 June, 2020;
originally announced June 2020.
-
Tensor extrapolation methods with applications
Authors:
F. P. A. Beik,
A. El Ichi,
K. Jbilou,
R. Sadaka
Abstract:
In this paper, we mainly develop the well-known vector and matrix polynomial extrapolation methods in tensor framework. To this end, some new products between tensors are defined and the concept of positive definitiveness is extended for tensors corresponding to T-product. Furthermore, we discuss on the solution of least-squares problem associated with a tensor equation using Tensor Singular Value…
▽ More
In this paper, we mainly develop the well-known vector and matrix polynomial extrapolation methods in tensor framework. To this end, some new products between tensors are defined and the concept of positive definitiveness is extended for tensors corresponding to T-product. Furthermore, we discuss on the solution of least-squares problem associated with a tensor equation using Tensor Singular Value Decomposition (TSVD). Motivated by the effectiveness of proposed vector extrapolation method in [Numer. Algorithms, 51 (2009), 195--208], we describe how an extrapolation technique can be also implemented on the sequence of tensors produced by truncated TSVD (TTSVD) for solving possibly ill-posed tensor equations.
△ Less
Submitted 12 April, 2020;
originally announced April 2020.
-
Structural Language Models of Code
Authors:
Uri Alon,
Roy Sadaka,
Omer Levy,
Eran Yahav
Abstract:
We address the problem of any-code completion - generating a missing piece of source code in a given program without any restriction on the vocabulary or structure. We introduce a new approach to any-code completion that leverages the strict syntax of programming languages to model a code snippet as a tree - structural language modeling (SLM). SLM estimates the probability of the program's abstrac…
▽ More
We address the problem of any-code completion - generating a missing piece of source code in a given program without any restriction on the vocabulary or structure. We introduce a new approach to any-code completion that leverages the strict syntax of programming languages to model a code snippet as a tree - structural language modeling (SLM). SLM estimates the probability of the program's abstract syntax tree (AST) by decomposing it into a product of conditional probabilities over its nodes. We present a neural model that computes these conditional probabilities by considering all AST paths leading to a target node. Unlike previous techniques that have severely restricted the kinds of expressions that can be generated in this task, our approach can generate arbitrary code in any programming language. Our model significantly outperforms both seq2seq and a variety of structured approaches in generating Java and C# code. Our code, data, and trained models are available at http://github.com/tech-srl/slm-code-generation/ . An online demo is available at http://AnyCodeGen.org .
△ Less
Submitted 29 July, 2020; v1 submitted 30 September, 2019;
originally announced October 2019.