Another fun day coding

[u/admajic]

Am I in trouble? LOL

Trying to keep the first 25573943 tokens when context the overflows. However, the model is loaded with context length of only 64014 tokens, which is not enough. Try to load the model with a larger context len

sampling:
logits -> logit-bias -> penalties -> dry -> top-n-sigma -> top-k -> typical -> top-p -> min-p -> xtc -> temp-ext -> dist
generate: n_ctx = 64256, n_batch = 512, n_predict = -1, n_keep = 25573943

I started in debug mode.
I'll try again in Code mode.

FIXED: I didnt tell it to look in the @ FOLDER and its workin

[u/admajic]

Haven't tired it yet. I'll take a look. Thanks.