Skip to content

Accept VPQ dataset in IVF-PQ search #2344

Description

@aamijar

Today, IVF-PQ search only accepts full-precision datasets.
We would like support for searching when the queries are VPQ quantized.

The baseline strategy to do this is to decompress the queries (based on batch_size to avoid full materialization) and reuse the existing search kernels. The current search kernels use Asymmetric Distance Computation (ADC).

We may investigate a better search kernel strategy to exploit the idea that the queries are also quantized.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

Status
In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions