Showing 1–10 of 10 results for author: Cakir, F

MLPerf Mobile Inference Benchmark

Authors: Vijay Janapa Reddi, David Kanter, Peter Mattson, Jared Duke, Thai Nguyen, Ramesh Chukka, Ken Shiring, Koan-Sin Tan, Mark Charlebois, William Chou, Mostafa El-Khamy, Jungwook Hong, Tom St. John, Cindy Trinh, Michael Buch, Mark Mazumder, Relia Markovic, Thomas Atta, Fatih Cakir, Masoud Charkhabi, Xiaodong Chen, Cheng-Ming Chiang, Dave Dexter, Terry Heo, Gunther Schmuelling , et al. (2 additional authors not shown)

Abstract: This paper presents the first industry-standard open-source machine learning (ML) benchmark to allow perfor mance and accuracy evaluation of mobile devices with different AI chips and software stacks. The benchmark draws from the expertise of leading mobile-SoC vendors, ML-framework providers, and model producers. It comprises a suite of models that operate with standard data sets, quality metrics… ▽ More This paper presents the first industry-standard open-source machine learning (ML) benchmark to allow perfor mance and accuracy evaluation of mobile devices with different AI chips and software stacks. The benchmark draws from the expertise of leading mobile-SoC vendors, ML-framework providers, and model producers. It comprises a suite of models that operate with standard data sets, quality metrics and run rules. We describe the design and implementation of this domain-specific ML benchmark. The current benchmark version comes as a mobile app for different computer vision and natural language processing tasks. The benchmark also supports non-smartphone devices, such as laptops and mobile PCs. Benchmark results from the first two rounds reveal the overwhelming complexity of the underlying mobile ML system stack, emphasizing the need for transparency in mobile ML performance analysis. The results also show that the strides being made all through the ML stack improve performance. Within six months, offline throughput improved by 3x, while latency reduced by as much as 12x. ML is an evolving field with changing use cases, models, data sets and quality targets. MLPerf Mobile will evolve and serve as an open-source community framework to guide research and innovation for mobile AI. △ Less

Submitted 6 April, 2022; v1 submitted 3 December, 2020; originally announced December 2020.

A Kernel Based High Order "Explicit" Unconditionally Stable Constrained Transport Method for Ideal Magnetohydrodynamics

Authors: Firat Cakir, Andrew Christlieb, Yan Jiang

Abstract: The ideal Magnetohydrodynamics (MHD) equations are challenging because one needs to maintain the divergence free condition, $\nabla \cdot \Bv = 0$. Many numerical methods have been developed to enforce this condition. In this work, we further our work on mesh aligned constrained transport by develo** a new kernel based approach for the vector potential in 2D and 3D. The approach for solving the… ▽ More The ideal Magnetohydrodynamics (MHD) equations are challenging because one needs to maintain the divergence free condition, $\nabla \cdot \Bv = 0$. Many numerical methods have been developed to enforce this condition. In this work, we further our work on mesh aligned constrained transport by develo** a new kernel based approach for the vector potential in 2D and 3D. The approach for solving the vector potential is based on the method of lines transpose and is A-stable, eliminating the need for diffusion limiters needed in our previous work in 3D. The work presented here is an improvement over the previous method in the context of problems with strong shocks due to the fact that we could eliminate the diffusion limiter that was needed in our previous version of constrained transport. The method is robust and has been tested on the 2D and 3D cloud shock, blast wave and field loop problems. △ Less

Submitted 2 August, 2019; originally announced August 2019.

Hashing with Binary Matrix Pursuit

Authors: Fatih Cakir, Kun He, Stan Sclaroff

Abstract: We propose theoretical and empirical improvements for two-stage hashing methods. We first provide a theoretical analysis on the quality of the binary codes and show that, under mild assumptions, a residual learning scheme can construct binary codes that fit any neighborhood structure with arbitrary accuracy. Secondly, we show that with high-capacity hash functions such as CNNs, binary code inferen… ▽ More We propose theoretical and empirical improvements for two-stage hashing methods. We first provide a theoretical analysis on the quality of the binary codes and show that, under mild assumptions, a residual learning scheme can construct binary codes that fit any neighborhood structure with arbitrary accuracy. Secondly, we show that with high-capacity hash functions such as CNNs, binary code inference can be greatly simplified for many standard neighborhood definitions, yielding smaller optimization problems and more robust codes. Incorporating our findings, we propose a novel two-stage hashing method that significantly outperforms previous hashing studies on widely used image retrieval benchmarks. △ Less

Submitted 6 August, 2018; originally announced August 2018.

Comments: 23 pages, 4 figures. In Proceedings of European Conference on Computer Vision (ECCV), 2018

Hashing with Mutual Information

Authors: Fatih Cakir, Kun He, Sarah Adel Bargal, Stan Sclaroff

Abstract: Binary vector embeddings enable fast nearest neighbor retrieval in large databases of high-dimensional objects, and play an important role in many practical applications, such as image and video retrieval. We study the problem of learning binary vector embeddings under a supervised setting, also known as hashing. We propose a novel supervised hashing method based on optimizing an information-theor… ▽ More Binary vector embeddings enable fast nearest neighbor retrieval in large databases of high-dimensional objects, and play an important role in many practical applications, such as image and video retrieval. We study the problem of learning binary vector embeddings under a supervised setting, also known as hashing. We propose a novel supervised hashing method based on optimizing an information-theoretic quantity: mutual information. We show that optimizing mutual information can reduce ambiguity in the induced neighborhood structure in the learned Hamming space, which is essential in obtaining high retrieval performance. To this end, we optimize mutual information in deep neural networks with minibatch stochastic gradient descent, with a formulation that maximally and efficiently utilizes available supervision. Experiments on four image retrieval benchmarks, including ImageNet, confirm the effectiveness of our method in learning high-quality binary embeddings for nearest neighbor retrieval. △ Less

Submitted 24 June, 2018; v1 submitted 2 March, 2018; originally announced March 2018.

Hashing as Tie-Aware Learning to Rank

Authors: Kun He, Fatih Cakir, Sarah Adel Bargal, Stan Sclaroff

Abstract: Hashing, or learning binary embeddings of data, is frequently used in nearest neighbor retrieval. In this paper, we develop learning to rank formulations for hashing, aimed at directly optimizing ranking-based evaluation metrics such as Average Precision (AP) and Normalized Discounted Cumulative Gain (NDCG). We first observe that the integer-valued Hamming distance often leads to tied rankings, an… ▽ More Hashing, or learning binary embeddings of data, is frequently used in nearest neighbor retrieval. In this paper, we develop learning to rank formulations for hashing, aimed at directly optimizing ranking-based evaluation metrics such as Average Precision (AP) and Normalized Discounted Cumulative Gain (NDCG). We first observe that the integer-valued Hamming distance often leads to tied rankings, and propose to use tie-aware versions of AP and NDCG to evaluate hashing for retrieval. Then, to optimize tie-aware ranking metrics, we derive their continuous relaxations, and perform gradient-based optimization with deep neural networks. Our results establish the new state-of-the-art for image retrieval by Hamming ranking in common benchmarks. △ Less

Submitted 9 October, 2018; v1 submitted 23 May, 2017; originally announced May 2017.

Comments: 15 pages, 3 figures. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018

MIHash: Online Hashing with Mutual Information

Authors: Fatih Cakir, Kun He, Sarah Adel Bargal, Stan Sclaroff

Abstract: Learning-based hashing methods are widely used for nearest neighbor retrieval, and recently, online hashing methods have demonstrated good performance-complexity trade-offs by learning hash functions from streaming data. In this paper, we first address a key challenge for online hashing: the binary codes for indexed data must be recomputed to keep pace with updates to the hash functions. We propos… ▽ More Learning-based hashing methods are widely used for nearest neighbor retrieval, and recently, online hashing methods have demonstrated good performance-complexity trade-offs by learning hash functions from streaming data. In this paper, we first address a key challenge for online hashing: the binary codes for indexed data must be recomputed to keep pace with updates to the hash functions. We propose an efficient quality measure for hash functions, based on an information-theoretic quantity, mutual information, and use it successfully as a criterion to eliminate unnecessary hash table updates. Next, we also show how to optimize the mutual information objective using stochastic gradient descent. We thus develop a novel hashing method, MIHash, that can be used in both online and batch settings. Experiments on image retrieval benchmarks (including a 2.5M image dataset) confirm the effectiveness of our formulation, both in reducing hash table recomputations and in learning high-quality hash functions. △ Less

Submitted 29 July, 2017; v1 submitted 26 March, 2017; originally announced March 2017.

Comments: International Conference on Computer Vision (ICCV), 2017

Online Supervised Hashing for Ever-Growing Datasets

Authors: Fatih Cakir, Sarah Adel Bargal, Stan Sclaroff

Abstract: Supervised hashing methods are widely-used for nearest neighbor search in computer vision applications. Most state-of-the-art supervised hashing approaches employ batch-learners. Unfortunately, batch-learning strategies can be inefficient when confronted with large training datasets. Moreover, with batch-learners, it is unclear how to adapt the hash functions as a dataset continues to grow and div… ▽ More Supervised hashing methods are widely-used for nearest neighbor search in computer vision applications. Most state-of-the-art supervised hashing approaches employ batch-learners. Unfortunately, batch-learning strategies can be inefficient when confronted with large training datasets. Moreover, with batch-learners, it is unclear how to adapt the hash functions as a dataset continues to grow and diversify over time. Yet, in many practical scenarios the dataset grows and diversifies; thus, both the hash functions and the indexing must swiftly accommodate these changes. To address these issues, we propose an online hashing method that is amenable to changes and expansions of the datasets. Since it is an online algorithm, our approach offers linear complexity with the dataset size. Our solution is supervised, in that we incorporate available label information to preserve the semantic neighborhood. Such an adaptive hashing method is attractive; but it requires recomputing the hash table as the hash functions are updated. If the frequency of update is high, then recomputing the hash table entries may cause inefficiencies in the system, especially for large indexes. Thus, we also propose a framework to reduce hash table updates. We compare our method to state-of-the-art solutions on two benchmarks and demonstrate significant improvements over previous work. △ Less

Submitted 10 November, 2015; originally announced November 2015.

Visual Word Selection without Re-Coding and Re-Pooling

Authors: Fatih Cakir, Stan Sclaroff

Abstract: The Bag-of-Words (BoW) representation is widely used in computer vision. The size of the codebook impacts the time and space complexity of the applications that use BoW. Thus, given a training set for a particular computer vision task, a key problem is pruning a large codebook to select only a subset of visual words. Evaluating possible selections of words to be included in the pruned codebook can… ▽ More The Bag-of-Words (BoW) representation is widely used in computer vision. The size of the codebook impacts the time and space complexity of the applications that use BoW. Thus, given a training set for a particular computer vision task, a key problem is pruning a large codebook to select only a subset of visual words. Evaluating possible selections of words to be included in the pruned codebook can be computationally prohibitive; in a brute-force scheme, evaluating each pruned codebook requires re-coding of all features extracted from training images to words in the candidate codebook and then re-pooling the words to obtain a representation of each image, e.g., histogram of visual word frequencies. In this paper, a method is proposed that selects and evaluates a subset of words from an initially large codebook, without the need for re-coding or re-pooling. Formulations are proposed for two commonly-used schemes: hard and soft (kernel) coding of visual words with average-pooling. The effectiveness of these formulations is evaluated on the 15 Scenes and Caltech 10 benchmarks. △ Less

Submitted 23 July, 2014; originally announced July 2014.

Comments: 8 pages

Fuzzy Based Stator Flux Optimizer Design For Direct Torque Control

Authors: Fatih Korkmaz, M. Faruk Cakir, Yilmaz Korkmaz, Ismail Topaloglu

Abstract: Direct Torque Control (DTC) is well known as an effective control technique for high performance drives in a wide variety of industrial applications and conventional DTC technique uses two constant reference value: torque and stator flux. In this paper, a new fuzzy based stator flux optimizer has been proposed for DTC controlled induction motor drivers and simulation studies have been carried out… ▽ More Direct Torque Control (DTC) is well known as an effective control technique for high performance drives in a wide variety of industrial applications and conventional DTC technique uses two constant reference value: torque and stator flux. In this paper, a new fuzzy based stator flux optimizer has been proposed for DTC controlled induction motor drivers and simulation studies have been carried out with Matlab/Simulink to compare the proposed system behaviours at vary load conditions. The most important feature of the proposed fuzzy logic based stator flux optimizer that it self-regulates the stator flux reference value using the motor load situation without need of any motor parameters. Simulation results show that the performance of the proposed DTC technique has been improved and especially at low-load conditions torque ripples are greatly reduced with respect to the conventional DTC. △ Less

Submitted 1 December, 2012; originally announced December 2012.

Comments: 9 pages

Stator flux optimization on direct torque control with fuzzy logic

Authors: Fatih Korkmaz, M. Faruk Cakir, Yilmaz Korkmaz, Ismail Topaloglu

Abstract: The Direct Torque Control (DTC) is well known as an effective control technique for high performance drives in a wide variety of industrial applications and conventional DTC technique uses two constant reference value: torque and stator flux. In this paper, fuzzy logic based stator flux optimization technique for DTC drives that has been proposed. The proposed fuzzy logic based stator flux optimiz… ▽ More The Direct Torque Control (DTC) is well known as an effective control technique for high performance drives in a wide variety of industrial applications and conventional DTC technique uses two constant reference value: torque and stator flux. In this paper, fuzzy logic based stator flux optimization technique for DTC drives that has been proposed. The proposed fuzzy logic based stator flux optimizer self-regulates the stator flux reference using induction motor load situation without need of any motor parameters. Simulation studies have been carried out with Matlab/Simulink to compare the proposed system behaviors at vary load conditions. Simulation results show that the performance of the proposed DTC technique has been improved and especially at low-load conditions torque ripple are greatly reduced with respect to the conventional DTC. △ Less

Submitted 21 July, 2012; originally announced July 2012.

Comments: 8 pages, 8 figures, Itca 2012 conference