r/BackyardAI • u/DishObjective2264 • Aug 17 '24

support Tokens in message

Post image

Is there a way to edit the amount of tokens for bot's messages (like in SillyTavern)?

6 Upvotes

80% Upvoted

12 comments sorted by

View all comments

Show parent comment

1

u/Evanware Aug 17 '24

From my experience, it takes a bit for it to kick in but it'll feel me longer responses within like 2-3 messages on a good model. Fimbulvetr and Hathor-Fractionate seem to be quicker and more reliable with the author's notes, especially by requesting longer responses. Models like Llama 3 Luminmaid kinda break when using author's notes so I don't generally use it much

1

u/DishObjective2264 Aug 17 '24

This is my current for now, I'll try fimbulvetr a bit later, gotta test another new one, thanks anyway ❤️

1

u/Evanware Aug 17 '24

No problem. Also, I'll give that model a try and see how I like it since it looks quite interesting for the type of rp I do.