-
Vector Transport Free Riemannian LBFGS for Optimization on Symmetric Positive Definite Matrix Manifolds
Authors:
Reza Godaz,
Benyamin Ghojogh,
Reshad Hosseini,
Reza Monsefi,
Fakhri Karray,
Mark Crowley
Abstract:
This work concentrates on optimization on Riemannian manifolds. The Limited-memory Broyden-Fletcher-Goldfarb-Shanno (LBFGS) algorithm is a commonly used quasi-Newton method for numerical optimization in Euclidean spaces. Riemannian LBFGS (RLBFGS) is an extension of this method to Riemannian manifolds. RLBFGS involves computationally expensive vector transports as well as unfolding recursions using…
▽ More
This work concentrates on optimization on Riemannian manifolds. The Limited-memory Broyden-Fletcher-Goldfarb-Shanno (LBFGS) algorithm is a commonly used quasi-Newton method for numerical optimization in Euclidean spaces. Riemannian LBFGS (RLBFGS) is an extension of this method to Riemannian manifolds. RLBFGS involves computationally expensive vector transports as well as unfolding recursions using adjoint vector transports. In this article, we propose two map**s in the tangent space using the inverse second root and Cholesky decomposition. These map**s make both vector transport and adjoint vector transport identity and therefore isometric. Identity vector transport makes RLBFGS less computationally expensive and its isometry is also very useful in convergence analysis of RLBFGS. Moreover, under the proposed map**s, the Riemannian metric reduces to Euclidean inner product, which is much less computationally expensive. We focus on the Symmetric Positive Definite (SPD) manifolds which are beneficial in various fields such as data science and statistics. This work opens a research opportunity for extension of the proposed map**s to other well-known manifolds.
△ Less
Submitted 3 October, 2021; v1 submitted 24 August, 2021;
originally announced August 2021.
-
Accurate and fast matrix factorization for low-rank learning
Authors:
Reza Godaz,
Reza Monsefi,
Faezeh Toutounian,
Reshad Hosseini
Abstract:
In this paper, we tackle two important problems in low-rank learning, which are partial singular value decomposition and numerical rank estimation of huge matrices. By using the concepts of Krylov subspaces such as Golub-Kahan bidiagonalization (GK-bidiagonalization) as well as Ritz vectors, we propose two methods for solving these problems in a fast and accurate way. Our experiments show the adva…
▽ More
In this paper, we tackle two important problems in low-rank learning, which are partial singular value decomposition and numerical rank estimation of huge matrices. By using the concepts of Krylov subspaces such as Golub-Kahan bidiagonalization (GK-bidiagonalization) as well as Ritz vectors, we propose two methods for solving these problems in a fast and accurate way. Our experiments show the advantages of the proposed methods compared to the traditional and randomized singular value decomposition methods. The proposed methods are appropriate for applications involving huge matrices where the accuracy of the desired singular values and also all of their corresponding singular vectors are essential. As a real application, we evaluate the performance of our methods on the problem of Riemannian similarity learning between two various image datasets of MNIST and USPS.
△ Less
Submitted 4 September, 2021; v1 submitted 21 April, 2021;
originally announced April 2021.
-
Integrated IoT and Cloud Environment for Fingerprint Recognition
Authors:
Ehsan Nadjaran Toosi,
Adel Nadjaran Toosi,
Reza Godaz,
Rajkumar Buyya
Abstract:
Big data applications involving the analysis of large datasets becomes a critical part of many emerging paradigms such as smart cities, social networks and modern security systems. Cloud computing has developed as a mainstream for hosting big data applications by its ability to provide the illusion of infinite resources. However, harnessing cloud resources for large-scale big data computation is a…
▽ More
Big data applications involving the analysis of large datasets becomes a critical part of many emerging paradigms such as smart cities, social networks and modern security systems. Cloud computing has developed as a mainstream for hosting big data applications by its ability to provide the illusion of infinite resources. However, harnessing cloud resources for large-scale big data computation is application specific to a large extent. In this paper, we propose a system for large-scale fingerprint matching application using Aneka, a platform or develo** scalable applications on the Cloud. We present the design and implementation of our proposed system and conduct experiments to evaluate its performance using resources from Microsoft Azure. Experimental results demonstrate that matching time for biometric information such as fingerprints in large-scale databases can be reduced substantially using our proposed system.
△ Less
Submitted 21 July, 2018;
originally announced July 2018.
