LocalAI support

[netandreus]

The Feature

Can you please add settings for OpenAI server (url).

Motivation, pitch

With this we can point Quivr to LocalAI server.

Twitter / LinkedIn details

No response

[bioshazard]

Was just lookin for this support. Will add it myself if someone doesn't beat me to it.

[wwjCMP]

Yes, it is very necessary.

[bioshazard]

I have had a ton of trouble getting Quivr up in the first place. It will be simple to add once I get a working environment.

Directly in code, you should just need base_url=http://localhost:8080/v1 (or wherever LocalAI is hosted) added as an option in the ChatOpenAI line here:

https://github.com/QuivrHQ/quivr/blob/main/backend/modules/brain/integrations/GPT4/Brain.py#L170

Tho a proper PR would include managing it as an ENV var.