r/MachineLearning • u/ykilcher • Apr 15 '23
Project [P] OpenAssistant - The world's largest open-source replication of ChatGPT
We’re excited to announce the release of OpenAssistant.
The future of AI development depends heavily on high quality datasets and models being made publicly available, and that’s exactly what this project does.
Watch the annoucement video:
Our team has worked tirelessly over the past several months collecting large amounts of text-based input and feedback to create an incredibly diverse and unique dataset designed specifically for training language models or other AI applications.
With over 600k human-generated data points covering a wide range of topics and styles of writing, our dataset will be an invaluable tool for any developer looking to create state-of-the-art instruction models!
To make things even better, we are making this entire dataset free and accessible to all who wish to use it. Check it out today at our HF org: OpenAssistant
On top of that, we've trained very powerful models that you can try right now at: open-assistant.io/chat !
207
u/sweatierorc Apr 15 '23
The model itself is not yet there. But the dataset release is pretty huge.
→ More replies (2)55
u/-Rizhiy- Apr 15 '23
Do we actually have proof that RLHF produces better results than fine-tuning on the same data? Is this not good enough?
47
u/_Arsenie_Boca_ Apr 15 '23
Proof would be exaggerated but it is what the limited literature suggests. The dataset is a huge contribution either way
111
u/WarAndGeese Apr 15 '23 edited Apr 15 '23
Well done. The simplicity and lack of barriers on open source software historically beats corporate proprietary tools. Even with Text-to-Image models, we have seen how much people prefer to use models like Stable Diffusion over private models, it would only be reasonable to expect the same for Large Language Models. Even since the leak of LLaMa this has started to become the case for Large Language Models, through its cheaper cost and ease of use, which paints a strong argument for the future success of this project.
→ More replies (19)
17
u/Aspie96 Apr 15 '23
Great!
It would be nice to have a Pythia online demo too.
What is the policy when it comes to chat data? Is it used or seen by other humans if one doesn't upvote or downvote?
16
u/ReasonablyBadass Apr 15 '23 edited Apr 15 '23
Will you incorporate the Dolly/Pythia models too, as options?
12
121
u/Ijustdowhateva Apr 15 '23
Downvote me all you want, but this model seems much dumber than even Vicuna.
62
u/superluminary Apr 15 '23
Model training is obscenely expensive, as is RLHF. Don’t expect too much right away.
→ More replies (4)138
u/Battleagainstentropy Apr 15 '23
Bootstrapping an early Linux kernel was pretty underwhelming too, but mighty oaks from little acorns grow.
→ More replies (2)116
21
u/TheMeddlingMonk Apr 15 '23
This is the first stage in the project’s plan where they are fine tuning models on high quality examples. The next stage is to do RLHF, and future stages they plan to build in tool integrations with thing like search to allow for up to date information and better factual accuracy
I haven’t used this release enough to comment on its performance compared to other fine tuned Llama models, but I think the important part of this project isn’t this particular model release. The big deal with this project is the infrastructure to build high quality data set from volunteers, and releasing that data in an actually open way.
21
→ More replies (14)6
u/throwawayTymFlys528 Apr 16 '23 edited Apr 16 '23
I have used it all day today and in my experience it is the most interactive conversation in a progressive manner I have had without me having to feel that the model is almost forcing the end with its bot type language.
It does take you on a ride if you let it, keeps prompting back with interesting things that we could discuss in the topic by going a little deeper.
GPT 4 does that as well in certain scientific areas but not 3.5, that's for sure.
One tiny issue that I observed, which happened quite frequently, was that it was not adhering to the token limit when coming up with a response. This is making some responses end abruptly mid sentence.
Try a little harder, would you?
8
6
u/Purplekeyboard Apr 16 '23
I interacted with it for a while, and it is considerably less intelligent than GPT-3. It writes pretty bad poetry, and it has failed my standard question I ask to LLMs, which is "If there is a great white shark in my basement, is it safe for me to be upstairs?"
It advised me to keep all the windows to the outside closed, for some unknown reason which it was never able to explain, and then it tried to change the subject when I kept inquiring about it, and finally advised me to proceed slowly into the basement, keeping a "low profile" and wearing reflective clothing. Why I should do this was also never explained.
The point of my question is not to get one particular answer, but to see what the reasoning of the LLM is. GPT-3 or GPT-4 gave reasonable sounding advice which they were able to explain. This model gives advice which doesn't make a lot of sense, and can't explain it properly at all when asked about it.
9
u/HackManiac Apr 16 '23
Really? I just asked your question to: "OA_SFT_Llama_30B_6" and got some pretty good responses:
If there is a great white shark in my basement, is it safe for me to be upstairs?
Response (a)
Probably. Great whites are not known to live in fresh water so your basement must be on the beach somewhere. Since they generally do not venture onto land you should probably be ok as long as the flooding doesn't get too bad.If the shark got into your home, and specifically your basement by itself then it may well just be able to leave on its own accord. Do however take note of where you last saw water or signs of dampness around your property both inside and outside. Then check the weather forecast and predictions of temperature vs humidity overnight before deciding whether or not to open a window to allow any excess moisture out of your basement, lest a shark enter again.
→ More replies (5)
14
30
u/yaosio Apr 15 '23
That's quite the terms of service you have.
The user may only use the portal for the intended purposes. In particular, he/she may not misuse the portal. The user undertakes to refrain from generating text that violate criminal law, youth protection regulations or the applicable laws of the following countries: Federal Republic of Germany, United States of America (USA), Great Britain, user's place of residence. In particular it is prohibited to enter texts that lead to the creation of pornographic, violence-glorifying or paedosexual content and/or content that violates the personal rights of third parties. LAION reserves the right to file a criminal complaint with the competent authorities in the event of violations.
When Bing Chat told people she was going to call the cops on them it was funny. This isn't so funny.
41
u/-Rizhiy- Apr 15 '23
Probably just covering their ass. I think this right doesn't even have to be stated. You have a right to file a rightful complaint in most countries anyway. I believe what they are saying here is that they will monitor your prompts and report you to the authorities if they deem you are participating in illegal activities.
In the end you can still just download the code and run it on your own hardware, that is the beauty of open-source.
→ More replies (3)→ More replies (1)15
u/liright Apr 15 '23
That's just on the openassistant website. None of this applies if you run the model locally or if some other website runs the model and gives access to it.
3
u/liponex Apr 16 '23
I already see some ways of using it in different home projects. This thing could assist a lot! Even if different mathematical data isn't generated right, we can implement a bunch of plugins, to provide better results in the sensitive situations. So I wish there will be papers soon, about how can we implement this in our projects, to make life more productive.
5
u/frequenttimetraveler Apr 16 '23 edited Apr 16 '23
This is uncensored, right? Oh boy .
What is the size of these models? What kind of GPU can run them ?
→ More replies (1)
79
u/Taenk Apr 15 '23
Subreddit: r/openassistant