Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Add support for FAISS AVX512 #2056

Closed
akashsha1 opened this issue Sep 6, 2024 · 1 comment · Fixed by #2110
Closed

[FEATURE] Add support for FAISS AVX512 #2056

akashsha1 opened this issue Sep 6, 2024 · 1 comment · Fixed by #2110

Comments

@akashsha1
Copy link
Contributor

Is your feature request related to a problem?
Improve performance of vector search and indexing when using the FAISS library, by using AVX512 accelerators which are supported in faiss.

What solution would you like?
Add support to use AVX512, initially as an optional feature and eventually enable by default on machines where AVX512 is supported on subsequent OpenSearch releases.
This will be a 2 part change:

  1. Adds necessary code in k-NN to check for AVX512 support on the machine.
  2. A separate change made in FAISS to add missing functions support for AVX512.
@naveentatikonda
Copy link
Member

Add support to use AVX512, initially as an optional feature and eventually enable by default on machines where AVX512 is supported on subsequent OpenSearch releases.

@akashsha1 If the performance metrics looks good, we want to enable and support AVX512 by default if the underlying hardware supports it just like how we did for AVX2. But, we will provide a static setting(reboot the node or cluster after setting it in opensearch.yml) to disable AVX512 just in case users don't want to use it, like we did for avx2 (knn.faiss.avx2.disabled)

Expectation is we will build and ship all 3 versions of faiss library(generic, with avx2, with avx512). If the underlying system supports avx512 we will load avx512 faiss lib, if not look for avx2 else generic faiss library.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Done
3 participants