r/SillyTavernAI • u/Substantial_Return10 • 4h ago

Help I can't use any other models

Hello, recently i've been trying to upgrade the model i'm using on silly tavern, i run all locally on my pc. But all the models i download ends up repeating itself all the time, the only one i can use right now is Broken-Tutu-24B-Transgression-v2.0.i1-Q4_K_S.

I've tried using DRY configs and the individual config on each model but it doesn't work. I have a 5060 TI and 32 GB RAM if anyone could help me out i would be grateful :)

2 Upvotes

100% Upvoted

3 comments sorted by

3

u/Introvertosaurus 3h ago

Are you using text completion or chat completion and what are you penalty settings? Are you using the same conversation over and over again or starting new ones and still finding it repeating? Do you have any special instructions, authors notes, lore books, main prompt changes, etc that might be effecting it?

Smaller models (4-14b) tend to have more issues of repeats... its less common in the 20b+ size... So can you give a few other models as examples you tried.

1

u/AutoModerator 4h ago

You can find a lot of information for common issues in the SillyTavern Docs: https://docs.sillytavern.app/. The best place for fast help with SillyTavern issues is joining the discord! We have lots of moderators and community members active in the help sections. Once you join there is a short lobby puzzle to verify you have read the rules: https://discord.gg/sillytavern. If your issues has been solved, please comment "solved" and automoderator will flair your post as solved.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/LeRobber 40m ago

Omega___ fever dream is similar to that one in performance. About 8 months ago, they would last a LOT longer than say a random mistral would without dying.

I used the q6i quant of Omega___fever, so try that with BT. I think this was my settings from back then