Use ChromaDB in server mode

[trguduru]

Hello,

I'm attempting to utilize ChromaDB in server mode and employ it in ChromaDB_VectorStore instead of using an in-memory/persistent filesystem within the Flask app.

I attempted to pass the HTTP address of the running Chroma server as the path in the config, but it didn't work...

Is there an option for this? I couldn't find this option; the only ChromaDB client options I see are persistent or in-memory.

[zainhoda]

You can actually pass in the chroma client into that parameter to set the client directly:

https://github.com/vanna-ai/vanna/blob/main/src/vanna/chromadb/chromadb_vector.py#L37

[trguduru]

Awesome, earlier i tried with passing the chromaDB http address but it sounds like its expecting an instance of Chroma Client as a config ...

Tried with the following and its working fine ..

chroma_client = chromadb.HttpClient(host='localhost', port=8000)
vn = MyVanna(config={'model': 'mistral', "client":chroma_client})

I was expecting to provide an HTTP address and build the client within Vanna implementation.