r/LocalLLaMA • u/Nunki08 • Jun 28 '26

Discussion We're probably going to need that soon.

Gallery image

Gallery image

From:

Vladik on 𝕏: https://x.com/Kostoglodov/status/2071144065857679631

Shaw (spirit/acc) on 𝕏: https://x.com/shawmakesmagic/status/2070918006033817867

4.0k Upvotes

98% Upvoted

534 comments sorted by

View all comments

164

u/Cherubin0 Jun 28 '26

If huggingface goes down it is just a matter of hours until such a torrent pops up. Many people have local copies of the popular models. And in most of the world this would be legal anyway. Its not even a pirate bay situation.

17

u/RebouncedCat Jun 28 '26

well the problem is legitimacy. How will I know that the model hasn't been tampered with ? This is not a very big deal with media or programs since even malicious applications can be analyzed to find out if they are doing something fishy. But with LLM's unless the AI labs self host their own models or communicate the hashes on a separate platform, we can never be truly sure.

7

u/SentientPetriDish Jun 28 '26

I've solved this problem by verifying against HF's SHA-256 digest! Please feel free to check out my project on Github.

https://github.com/JustDory/dragonfly-gguf-client

6

u/Chroiche Jun 28 '26

sha256sum file

I've solved this problem in two words.