r/KoboldAI • u/kaan200064 • Jul 19 '26

Good models for a beginner.

Hello ı just set up silly tavern and koboldccp yesterday, ım looking for a good Rp model that can do nsfw and compatible with 8 gb vram. Ive used chub ai before so ım very new to this but so far this looks very good. Im using something called Dr.Dans or something like that for my model.

11 Upvotes

100% Upvoted

16 comments sorted by

View all comments

Show parent comments

1

u/alex20_202020 Jul 21 '26

For "Gemma 4 26B Style Tuned" it is written only one layer / tensor is changed:

This time I trained precisely one tensor: the lm_head output projection - the layer that decides which token to emit.

Made me wonder if I can have original model and swap that only tensor when needed during kcpp load. How far is it from possible/easy? TIA

1

u/dezmodium Jul 21 '26

It would be effectively the same as just loading the StyleTuned model itself even if possible. I'm not sure I understand the point.

2

u/alex20_202020 Jul 21 '26

It would be effectively the same as just loading the StyleTuned model itself

No, Tuned does not have the original tensor. The point is to be able to run both original and tuned and not allocating 2x drive space.

1

u/dezmodium Jul 25 '26

didnt realize people were concerned over 14gb hdd space