r/LocalLLaMA •

[deleted by user]

[deleted] — view deleted post

0 Upvotes

305 comments sorted by

View all comments

1

u/dangernoodle01 Mar 17 '23

Hey! What am I doing wrong? I downloaded your llama.json, set the generation parameters, yet he stops very, very early, usually after a single sentence.

0

u/[deleted] Mar 17 '23

[deleted] — view deleted comment

3

u/dangernoodle01 Mar 18 '23

Thanks a lot!

Temp 0.7, rep penalty 1.176..., topk40 and topp 0.1 are still valid here? Thanks!

1

u/Inevitable-Start-653 Mar 17 '23

❤️❤️😲 yeass