I’m moving around Directus thanks to Google AI. However, sometimes it suggests features that are no longer available (or have been moved) in my current 11.17.0 version, so I was thinking of enabling the AI-Assistant which will at least be able to detect MY settings/collections/fields. I was wondering if anyone has had experience with this open Local AI or if it’s better to stick with Google’s. Thanks
Hey @Criss, if you do try it out, please come back and update us on how you find it! Would love to hear more about how it works for you.
I’ve not used this Local AI tool you linked. So I can’t really provide any guidance.
Most of the open source model testing I’ve done is with Ollama on a MacBook Pro. Or using vLLM on cloud infra.
We highly recommend the frontier models from the big cloud providers like OpenAI, Anthropic, and Google based on results in our testing, even if the cost is higher.
With open models your mileage in the AI Assistant will vary greatly depending on the model.
That said open models are getting better all the time. But currently the powerful open models still require a lot of firepower to run which most folks don’t have on standby.
Good luck in your testing.
After all, it’s all down to having a highly performing server with lots of RAM, isn’t it?