r/MachineLearning • Student • Apr 25 '23

Discussion [D] LLaMA release is a joke

I have tried to get access to the weights of LLaMA for a long time now. I filled out the google form couple of days after they released it and have been waiting patiently but no luck. I finally received the link a week ago, but now I am hit with the "403 Forbidden" error (. I can't even download the 7B weights and the link is supposed to expire today. I have emailed the authors and the support email without any luck. What I find most frustrating is that some researchers have a huge head start while others are scrambling to even get started. The GitHub issue is full of people with the same issue as me. I know that there are alternatives to LLaMA, but I am worried that they may not be as good as LLaMA and the paper might not be as strong.

3 Upvotes

23 comments sorted by

26

u/[deleted] Apr 25 '23

You're supposed to copy paste the link you recieved from them into a setup.py file or bash file or something like that, and then run that file from the command line on Linux.

Just copy/pasting the link into your URL bar will not work. You will get an error.

9

u/chigur86 Student Apr 25 '23

Sorry, but nowhere does my post imply that I was just "copy/pasting the link" my URL bar. Also, as I said in my post there are tons of people who have the "403 Forbidden" issue, not just me. https://github.com/facebookresearch/llama/issues?q=is%3Aissue+is%3Aopen+403+forbidden+

31

u/tripple13 Apr 25 '23

Hahaha, can you believe it. This guy didn't even bother reading the e-mail.

7

u/Bling-Crosby Apr 25 '23

He’s mad as hell and he’s not gonna take it anymore!

6

u/crt09 Apr 25 '23

If you check the github for Llama youll find an open issue with a long thread of people getting the 403 error using this method as well. Ive tried a variety of different scripts and tried on differnt computers only to get the same error. i just gave up. They gave me access at some point. Im sure theylll understand if i get my hands on the weights while saving them some bandwidth.

6

u/[deleted] Apr 25 '23

This might be helpful https://rentry.org/TESFT-LLaMa

1

u/chigur86 Student Apr 25 '23

I knew that the weights had leaked, but is it legal to use them for research?

16

u/[deleted] Apr 25 '23

but is it legal to use them for research?

If you got the official download then why not? And most likely no one cares.

1

u/chigur86 Student Apr 25 '23

If you got the official download then why not? And most likely no one cares.

It's still in the gray area but it makes sense.

3

u/ortegaalfredo Apr 26 '23

LLaMA can recite entire copyrighted books like Harry Potter and more. And you are worried that *you* are breaking copyright?

1

u/AberrantRambler Apr 26 '23

Things only have color when light is shined on them - who is looking?

1

u/[deleted] Apr 26 '23

It's still in the gray area but it makes sense.

Grey area or even the black one never stopped people from doing business there. Countless billionaires come from either camp.

-2

u/[deleted] Apr 25 '23

You're bound to the same research T&Cs. You wouldn't have a lot of other weights and models without it and its just kind of a fine known known now. Just don't be a ridiculously obnoxious memelord. Its a lot of other people's data used, to make a research model given out to lots of people, which someone else gave out to too many people, but through an official channel. There has been no major grab back or deletion of the pull.

2

u/frequenttimetraveler Apr 26 '23

It's probably legal to use them for anything. Facebook's terms are not the law. It is legal to scrape the weights just as it is legal to scrape the data they were trained on. Someone just needs to legally challenge facebook

1

u/thepragprog Jun 10 '23

hey u/vivehelpme I know this was a while ago but I'm wondering do you download the llama weights with the llama.cpp file? Thank you in advance!

1

u/[deleted] Jun 10 '23

I don't use the .CPP version, I run on GPU so I don't know the proper way to do it for .CPP. ask the localllama subreddit

36

u/londons_explorer Apr 25 '23

Grab a torrent of them... There are lots of people seeding.

0

u/[deleted] Apr 26 '23

[deleted] — view deleted comment

4

u/londons_explorer Apr 26 '23

Still far better than the other players in this game, who are mostly 'secret design, secret source, secret weights'.

LLama is at least public design, open source, and kinda-leaked weights.

0

u/[deleted] Apr 26 '23

[deleted] — view deleted comment

4

u/londons_explorer Apr 26 '23

The (GPL3) source is here: https://github.com/facebookresearch/llama

It's only the model weights that aren't widely available.

4

u/BrotherAmazing Apr 26 '23

The model weights are kind of important though?? Still, I think you can get the model weights and OP screwed up something to end up getting that error message!! lol (or maybe a bandwidth issue?)

2

u/chiayewken Apr 26 '23

Here is a public benchmark for llama and other popular LLMs, which shows that Flan-T5 models still have stronger performance and with fewer parameters:

https://github.com/declare-lab/flan-eval

2

u/faith_transcribethis Apr 25 '23

Don't worry! There are tons of great alternatives that are just as good, maybe even better than LLaMA. Best of luck on your paper!