There are two apps that you can use,

In this post, we will see about LMStudio.

LM Studio offers a straightforward solution: download AI models to your local system for enhanced data security, bypassing risky unknown endpoints.

But only for (M1, M2, M3) Mac users.

Visit the page LM studio and download to set up on your Mac

After installing LM Studio into your system, Do LM Studio → search→ Search the model is, “Llama-3-8B-Instruct-32k-v0.1-GGUF” and download it.

There are many AI models available in the LM Studio, we suggest to use, Llama3 quantised model from here,

Select the downloaded model,

Click the “Start Server” button

Now go to Elephas → Preference → AI Providers → Custom AI, and Enter your local host url.

And Tap on refresh models

Now go to Elephas → Preference → General, and you can pick a feature and select any LM Studio models available,

In Super Chat as well, you can select the LM studio models

Super brain indexing still requires internet connection as it depends on backend AI engine, we will add the offline capability soon.

You can now (from 10.x version) index Super Brain files using offline indexing models. Check out LM Studio’s Text Embeddings | LM Studio

Make sure to choose the embedding model before starting the server,

When creating a brain, choose the new local model,

Need help? We're Here for You!

Contact us in support@elephas.app.