GPU Support?

[jordanparker6]

Does qdrant support running on GPUs with CUDA?

[generall]

Hi, there is no such feature in the current version. We are considering using GPUs, but we don't make it a priority. In our experience, a much larger gain can be achieved by distributing the service between regular CPU machines. This would be cheaper and more efficient

[jordanparker6]

Thanks for the response. I really like this project. I will take your advice and try it out in a K8 cluster.

[dingusagar]

@generall , are there any guidelines on how to set up qdrant in a cluster setup. Will installing separate instances of qdrant on multiple nodes and mounting an AWS EFS on all the nodes to store the qdrant directory (collections and indices files) do the job. Or is there anything else that needs to be taken care of?

[generall]

@generall , are there any guidelines on how to set up qdrant in a cluster setup. Will installing separate instances of qdrant on multiple nodes and mounting an AWS EFS on all the nodes to store the qdrant directory (collections and indices files) do the job. Or is there anything else that needs to be taken care of?

Hi @dingusagar, cluster deployment is not yet supported. We are working on it as a part of v1.0 release. Please check out our roadmap for more details - https://github.com/qdrant/qdrant/blob/master/docs/roadmap/README.md

As a temporary workaround, you can try to implement your own proxy which will route requests among independent instances.