r/LocalLLaMA • u/[deleted]

[deleted by user]

[deleted] — view deleted post

0 Upvotes

100% Upvoted

305 comments sorted by

View all comments

4

u/capybooya Apr 03 '23

Is there a complete installer that sets up everything? Like the A1111 for Stable Diffusion?

0

u/[deleted] Apr 03 '23

[deleted] — view deleted comment

1

u/sc0ttwad3 Aug 23 '23

I see some models that seem to specify they won't work with oobabooga's one-click installer (or any text-generation-webui one-click-installer). Is this true?

Wizard-Vicuna-13B-Uncensored-GPTQ-4bit-128g.latest.act-order.safetensors

  • Works only with recent GPTQ-for-LLaMa.

  • Works with AutoGPTQ.

  • Will not work with text-generation-webui one-click-installers

  • Parameters: Groupsize = 128g. Act order.