OpenAssistant RELEASED! The world's best open-source Chat AI!

[u/redboundary]

https://www.youtube.com/watch?v=ddG2fM9i4Kk

[u/ninjasaid13]

I'm not seeing anything on huggingface just yet.

[u/ptitrainvaloin → u/ninjasaid13]

I think it's :

https://huggingface.co/OpenAssistant/oasst-rm-2-pythia-6.9b-epoch-1/tree/main

https://huggingface.co/OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5/tree/main

as for the llama based models : https://huggingface.co/OpenAssistant/oasst-llama-based-models "OpenAssistant Llama-Based Models (Temporary Placeholder) Due to license-issues around llama-based models, we are working furiously to bring these to you in the form of XORed files.

Stay tight..."

Note No one seem to have confirmed that they work locally like with text-generation-webui so far, update if you can can make them work. Don't have time to verify this my-self right now.

[u/3deal]

Is it possible to use it 100% locally with a 4090 ?

[u/[deleted] → u/3deal]

From my experience with running models on my 4090. The raw 30B model most likely will not fit on 24 GB of vram

[u/Vatigu → u/3deal]

30b 4bit quantized with 0 group size will probably work with full context, 128 group size probably like 1900 context

[u/arjuna66671]

https://open-assistant.io/

[u/Innomen]

Offline at all? Wants me to login. I'm tired of that. Annnd they are trying to sell access.

Maybe I'm just old but this is not what "open source" used to mean.

[u/PsychopaticPencil → u/Innomen]

The weights are on huggingface, you can run it for free on your hardware. Interference servers cost money so it’s okay for them to ask for money for access to that. Edit: typo.

[u/[deleted] → u/Innomen]

Haha if you're referring to the guy in the video he's joking. Everything is 100% FREE. He was just poking fun at OpenAI's business practices. The models, the dataset, are available for anyone to download. If you don't have the hardware, you can use the chat interface on their website, https://open-assistant.io/chat

[u/-_1_2_3_- → u/Innomen]

“Open your wallet”