Computer Science > Computer Vision and Pattern Recognition
[Submitted on 10 Dec 2014 (v1), last revised 1 Mar 2017 (this version, v7)]
Title:Memory vectors for similarity search in high-dimensional spaces
View PDFAbstract:We study an indexing architecture to store and search in a database of high-dimensional vectors from the perspective of statistical signal processing and decision theory. This architecture is composed of several memory units, each of which summarizes a fraction of the database by a single representative vector. The potential similarity of the query to one of the vectors stored in the memory unit is gauged by a simple correlation with the memory unit's representative vector. This representative optimizes the test of the following hypothesis: the query is independent from any vector in the memory unit vs. the query is a simple perturbation of one of the stored vectors.
Compared to exhaustive search, our approach finds the most similar database vectors significantly faster without a noticeable reduction in search quality. Interestingly, the reduction of complexity is provably better in high-dimensional spaces. We empirically demonstrate its practical interest in a large-scale image search scenario with off-the-shelf state-of-the-art descriptors.
Submission history
From: Ahmet Iscen [view email][v1] Wed, 10 Dec 2014 14:56:41 UTC (171 KB)
[v2] Thu, 11 Dec 2014 17:11:21 UTC (171 KB)
[v3] Mon, 19 Jan 2015 14:47:33 UTC (166 KB)
[v4] Tue, 23 Jun 2015 20:53:08 UTC (412 KB)
[v5] Tue, 29 Dec 2015 15:16:22 UTC (453 KB)
[v6] Tue, 3 Jan 2017 13:48:57 UTC (1,112 KB)
[v7] Wed, 1 Mar 2017 21:14:52 UTC (1,009 KB)
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.