[BUG]Issue with Qdrant Collection Configuration Filter in JSON Payload

[samsam002]

Description:
I am trying to send a JSON payload with a specific filter configuration according to the Flowise documentation. However, I am encountering issues with the filter not working as expected.

JSON Payload:

{
    "question": "isms",
    "overrideConfig": {
        "qdrantCollectionCofiguration": {
            "filter": {
                "must": [
                    {
                        "key": "classuers",
                        "match": {
                            "any": [
                                "black",
                                "yellow"
                            ]
                        }
                    }
                ]
            }
        }
    }
}

Expected Outcome:
I expected the filter to work correctly, filtering the results based on the classuers field matching any of the specified values ("black", "yellow").

But it never filters the output.

Here is the strucutre of points in Qdrant

[Anush008]

Hey @samsam002. Could you provide your flow-setup?

[samsam002]

hey, here is it,

[samsam002]

thanks for the reactivity,
the steps are as mentioned in the issue, the qdrant vector store already contains data upserted outside of the flow, it does return relevant information but from the whole collection,
i tried all the possible combination to apply the filters, still get the search result without filters applied. in qdrant dashboard console, they get filtered successfully.

i'm wondering if the args qdrantCollectionCofiguration is even meant for filtering ?

[Anush008]

I seem to have found the issue here. You're trying to filter the results by passing the filter obj to the qdrantCollectionConfiguration property, which is meant to receive a collection creation config.
https://github.com/qdrant/qdrant-js/blob/b9f9333c491c41819518f4e58d6df002a7032108/packages/js-client-rest/src/openapi/generated_schema.ts#L1093-L1134

[samsam002]

thanks for the feedback, any clue to get filtered result as in the "pinecone load existing " one ?

[Anush008]

As of now, the filters params aren't configurable when querying with Flowise and Qdrant.

I'll see to parameterize this value.

[Anush008]

I'm working on adding the filter. Should be done by today if everything goes right. I'll let you know when the PR is up.

[Anush008]

@samsam002, you can checkout #912.

{
   "question":"Your question",
   "overrideConfig":{
      "qdrantFilter":{
         "must":[
            {
               "key":"classuers",
               "match":{
                  "any":[
                     "black",
                     "yellow"
                  ]
               }
            }
         ]
      }
   }
}

Should be usable now.

[samsam002]

GREAT thanks to you. i'll test it out and feed back.