-
Notifications
You must be signed in to change notification settings - Fork 144
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[FEATURE] Add support for FAISS AVX512 #2056
Comments
@akashsha1 If the performance metrics looks good, we want to enable and support AVX512 by default if the underlying hardware supports it just like how we did for AVX2. But, we will provide a static setting(reboot the node or cluster after setting it in opensearch.yml) to disable AVX512 just in case users don't want to use it, like we did for avx2 ( Expectation is we will build and ship all 3 versions of faiss library(generic, with avx2, with avx512). If the underlying system supports avx512 we will load avx512 faiss lib, if not look for avx2 else generic faiss library. |
Is your feature request related to a problem?
Improve performance of vector search and indexing when using the FAISS library, by using AVX512 accelerators which are supported in faiss.
What solution would you like?
Add support to use AVX512, initially as an optional feature and eventually enable by default on machines where AVX512 is supported on subsequent OpenSearch releases.
This will be a 2 part change:
The text was updated successfully, but these errors were encountered: