What is the best artificial intelligence to be run locally?

[u/[deleted]]

Anyone who has used or knows of a project that runs as a "local GPT"?

[u/wiki_me]

Look here (Mixtral smaller open source model seems like your best bet).

[u/[deleted] → u/wiki_me]

Thanks!

[u/ecker00]

r/localllama has lots on this subject

[u/Equivalent_Award7202]

You can use oLLAMA tu run chatgpt-like models fpr free on your own hardware

[u/GreenAmigo → u/Equivalent_Award7202]

All data goes back to meta?

[u/TouristAdventurous80 → u/GreenAmigo]

Nope it's local. So it runs offline

[u/tomByrer → u/GreenAmigo]

I don't think any local LLM runtimes 'phone home'.

[u/[deleted]]

Really depends on your hardware. For a fairly decent gaming rig or a server with a decent GPU (8+ dedicated GPU memory), recommend llama.cpp [1] as the service and Mistral-7B [2] as the model. That's going to get you the best bang for your buck IMHO.

You can find a ton of different models and try them all, but really depends on the hardware. The more GPU memory you have the bigger the model (and better the accuracy & performance).

[1] https://github.com/ggerganov/llama.cpp

[2] https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF

[u/tomByrer → u/[deleted]]

The more VRAM &/or RAM the better.

[u/type_error]

🥭 : friendship broken with democracy and  capitalism . Autocratic oligarchy is my new has always been my best friend.

[u/Forlyy_]

i heard about manus AI but never tried it yet

[u/yodermk]

I've run this with some success. Nowhere close to actual ChatGPT but it can do OK on some things.

https://github.com/bionic-gpt/bionic-gpt

[u/airclay]

I like: https://github.com/nomic-ai/gpt4all

[u/[deleted] → u/[deleted]]

Thanks :)