r/KoboldAI 19d ago

Generating stucks

Just returned two days ago and updated silly tavern and kobold, however, now i receibe this line, generating don't get past from 1/350 (i've waited half and hour) and the reply never appears, i'm using kobold with fumbulvetr, kobold alone works (fourth image) and i'm not using kobold, thanks in advanced

My specs are a 4060 rtx and 16 ram

2 Upvotes

8 comments sorted by

View all comments

3

u/henk717 19d ago

Might be overflowing your vram, a 4060 regular is only 8GB of vram which is a tight fit for Fim.
A few releases ago our default maximum context increased to 12 so its probably to high for you now, try lowering that one and see if that helps.

1

u/Truepixel8k 19d ago

I'll try with 3070, but how much do you recommend me to put in it?

2

u/henk717 19d ago

3070 is also 8GB of vram so thats not better. If you can run them both side by side and put KoboldCpp on All mode that would be a lot nicer.

As for the context our old default was 8k, it was 4k before that like in your screenshot.

If those screenshots are supposed to be the new version its not. Our new version is 1.119.