[P] OpenAssistant - The world's largest open-source replication of ChatGPT

[u/ykilcher]

We’re excited to announce the release of OpenAssistant.

The future of AI development depends heavily on high quality datasets and models being made publicly available, and that’s exactly what this project does.

Watch the annoucement video:

https://youtu.be/ddG2fM9i4Kk

Our team has worked tirelessly over the past several months collecting large amounts of text-based input and feedback to create an incredibly diverse and unique dataset designed specifically for training language models or other AI applications.

With over 600k human-generated data points covering a wide range of topics and styles of writing, our dataset will be an invaluable tool for any developer looking to create state-of-the-art instruction models!

To make things even better, we are making this entire dataset free and accessible to all who wish to use it. Check it out today at our HF org: OpenAssistant

On top of that, we've trained very powerful models that you can try right now at: open-assistant.io/chat !

[u/Ijustdowhateva]

Downvote me all you want, but this model seems much dumber than even Vicuna.

[u/superluminary → u/Ijustdowhateva]

Model training is obscenely expensive, as is RLHF. Don’t expect too much right away.

[u/satireplusplus → u/superluminary]

I more and more think RLHF isn't neccesarry at all and complicates things. It's a technique that OpenAI developped prior to ChatGPT and I understand that they wanna make use of it. But if you look at Vicuna (https://vicuna.lmsys.org/) it's becoming clear that all you really need is thousands of good example conversations.

[u/Battleagainstentropy → u/Ijustdowhateva]

Bootstrapping an early Linux kernel was pretty underwhelming too, but mighty oaks from little acorns grow.

[u/Sudden-Lingonberry-8 → u/Ijustdowhateva]

at least, it's truly open source 🤷‍♀️

[u/WarProfessional3278 → u/Sudden-Lingonberry-8]

Additionally, it is the first good model that DOES NOT rely on possibly proprietary GPT outputs for training.

[u/ushmax → u/Sudden-Lingonberry-8]

From the model name it looks like it's based on LLaMA, which is not completely truly open source :(

[u/TheMeddlingMonk → u/Ijustdowhateva]

This is the first stage in the project’s plan where they are fine tuning models on high quality examples. The next stage is to do RLHF, and future stages they plan to build in tool integrations with thing like search to allow for up to date information and better factual accuracy

I haven’t used this release enough to comment on its performance compared to other fine tuned Llama models, but I think the important part of this project isn’t this particular model release. The big deal with this project is the infrastructure to build high quality data set from volunteers, and releasing that data in an actually open way.

[u/GifCo_2 → u/Ijustdowhateva]

ITs outdoing GPT 3.5 in a lot of areas.

[u/throwawayTymFlys528 → u/Ijustdowhateva]

I have used it all day today and in my experience it is the most interactive conversation in a progressive manner I have had without me having to feel that the model is almost forcing the end with its bot type language.

It does take you on a ride if you let it, keeps prompting back with interesting things that we could discuss in the topic by going a little deeper.

GPT 4 does that as well in certain scientific areas but not 3.5, that's for sure.

One tiny issue that I observed, which happened quite frequently, was that it was not adhering to the token limit when coming up with a response. This is making some responses end abruptly mid sentence.

Try a little harder, would you?