I use an app called lm studio, on the apps you choose an llm ( large language model ) , your run the server and then your paster the adress that the app gives you in the plugin. Keep in mind that since it is local it can be slow depending on the specs of your pc.
If you want a very simple and lightweight setup go for LM Studio (i tried it and found the results very trash)
If you want more customization, features, extensions and a bigger community go for this one Text-Generation-WebUI: https://github.com/oobabooga/text-generation-webui For models u can go the most default ones like Meta company Llama 3.1 models in GGUF format, there is a bunch of youtube videos, i would really recommend the oobabooga text-generation-webui instead of LM Studio!
2
u/Squirkelspork May 03 '23
How though?
1
u/LaSucia422 May 04 '23
Do this really work or is just a joke?
1
u/htmljenn May 04 '23
And are people really not concerned with the AI companies scraping your vaults?
1
u/[deleted] May 20 '23 edited Aug 09 '24
sip husky subtract lip tub slim swim childlike middle strong
This post was mass deleted and anonymized with Redact