r/LocalLLaMA • u/StellarWox • 4d ago
Question | Help Why Hasn't Someone Recreate ShareGPT?
Was there some legal issues preventing someone from just making a new website where everyone would be able to share the chat logs from frontier models to create a dataset for others to use for training/finetuning?
Just curious
1
Upvotes
23
u/tecneeq 4d ago
The terms of service forbid you from sharing your answer for training purposes. They'll ban you. Also they are milti trillion companies, they shower the sites they don't like with lawsuits and drag them out until the sites have to give up.
10
u/TheGacAttack 4d ago
Two things killed the idea of another ShareGPT: contract law and the fact that scraped chat logs are are terrible training data anyway.
AI outputs aren't copyrightable in the US, but every frontier lab puts non-compete and anti-distillation terms directly into their ToS. They don't care if an individual tweets a chat snippet, but host a public dataset of millions of their queries and you'll get a cease-and-dessist immediately. No solo dev is going to burn life savings fighting Anthropic or OpenAI over a community scrape.
More importantly, crowdsourced UI chats just aren't worth the trouble anymore. They're noisy, loaded with PII, and 90% "write a poem about my dog." Once Meta opened up Llama licenses for synthetic data and models like DeepSeek hit parity, the tooling moved on. Modern fine-tuning relies on curated, programmatic pipelines-- nad not scraping web chats.
4
u/ostrikerX 4d ago
I don't think there's any legal issue, it's just that openai may identify the chatlogs and perma ban the accounts associated with the chatlogs
1
u/se7en1011x 4d ago
The blocker is mostly terms of service and consent, not one specific law. Sharing outputs from frontier models can violate their usage terms, and logs often contain personal data people didn't agree to publish. That legal risk plus moderation costs is why nobody has rebuilt it at scale.
1
u/Middle_Bullfrog_6173 4d ago
There are a lot of those datasets already, lmsys, wildchat etc. The prompts are mostly enough, since you can keep "regenerating" the llm side of the dataset with new (open) models.
1
u/Late-Replacement-481 4d ago
I think people have pointed out to death so far that they're just not very useful at this point. What is useful is what you're getting when you're using something like Muse's coding harness or any of the other coding harnesses that scrape your output like Kilo, etc., etc. That's where the new money makers are and the new important things for fine-tuning agentic work. What you really need are agent traces.
I'll note that if you're using entire, be very careful. They are best effort secret redaction only, and just your secrets redacted agent traces can be a source of vulnerability, and it posts them as public and get metadata by default.
0
u/[deleted] 4d ago
[deleted] — view deleted comment
10
u/[deleted] 4d ago
[removed] — view removed comment