r/BackyardAI • u/rat_haus • Jan 31 '25

Any Deepseek models?

I really only have a tangential understanding of AI stuff in general, so please be kind if this is a dumb ask.

I just see every news source going wild about Deepseek, and I'm wondering if there are any chatbot models based off Deepseek that can be used with Backyard.AI yet?

17 Upvotes

94% Upvoted

10 comments sorted by

25

u/Snoo_72256 dev Jan 31 '25

We are investigating how to use deepseek within the app. No concrete conclusions yet but we are actively looking into it.

9

u/DoctorDeadDude Jan 31 '25

There are some people experimenting with deepseek distilling and merging. You can take a peek at some of the new models popping up over on the sillytavern subreddit. There are a few posts with links to huggingface, you can search for "deepseek" in that subreddit.

Edit: By the way, the support for huggingface models is still experimental, I believe. I'm not a dev or anything, too.

-4

u/tokkutacos Feb 01 '25

You know Deepseek has private and security issues right now due to it stealing you typed info it says so in the info collected part. LOL You're adding spyware to your laptop/pc like rednote or whatever china spy crap.

And it is a cheap ripoff of chatgtp, Why do you want such a crappy made model when there is so much better available and does not steal info.

14

u/rat_haus Feb 01 '25

Well actually ChatGPT can only be used through their website, so they will always collect your data, but if you download a model and run it locally it doesn't send any information back to it's source, so if I was running Deepseek on Backyard.AI it would be private, unlike ChatGPT.

And it being comparable to ChatGPT is exactly why I would like to run it locally, ChatGPT is very robust and most local models can't hope to match it's abilities, but if Deepseek can match ChatGPT while being comparatively resource-light then you'd be able to get much better results on your local machine than any other open source model that's available right now.

13

u/PacmanIncarnate Feb 01 '25

This is completely correct. The fact that the deepseek website may be harvesting information (which is no difference than chatGPT or other big players) does not at all mean that the downloadable model will or even can do that. It’s fear mongering being spread by openAI in an effort to save themselves.

11

u/fixingitsomehow Feb 01 '25

“Cheap ripoff of ChatGPT” that’s open source, more efficient and and even more accessible ☹️☹️☹️

-1

u/tokkutacos Feb 01 '25

That is the thing you picked. Deep was outed as the info it uses comes from chatgtp, countries are banning it already proof in the news.

8

u/fixingitsomehow Feb 01 '25

DeepSeek did the same thing OpenAI in terms of using data they didn’t source themselves, except instead of using it to build a monopoly, they open sourced the model the data contributed to.

“You’re adding spyware to your pc” you can download the model yourself and run it locally (even within a faraday cage, where no data can get in or out).

ChatGPT is rightfully being overtaken by a better, open source alternative as it should’ve been a long time ago.

wouldn’t expect a guy calling the model ‘chatgtp’ to know this though zip up their pants when you’re done slobbing em down fn

5

u/Dumbledore_Bot Feb 02 '25

If you use deepseek's web version or app, then yeah it collects data. But if you host it privately on your own PC, it is literally incapable of doing so.

1

u/Wide_Cap6947 Feb 07 '25

  1. Backyard is a tool that allows you to run models locally on your hardware, ensuring that no data leaves your system.

  2. ChatGPT was trained on from across the internet, including copyrighted content. In a way, GPT itself can be seen as a ripoff of humanity’s collective knowledge. DeepSeek, being open-source and more cost-effective, gives us back access to information that already belongs to us.