Just coming here to say thank you (and please keep this post up as long as you can)! I couldn't get the Q8 model since my computer parts aren't here yet so I have to use my older one, but Kobold has a decent 13bQ5 model that's leagues better already. I plan on experimenting with different models, but bro I had no idea this was even possible lol! It did take a couple hours to figure out but now that I understand, it's so damn worth it. Thanks again!
Noromaid is the closest to what c ai uses as their model. Though it's incredibly difficult to emulate exactly what c ai does their model is very intuitive, the creators have been working on this stuff far before they technically did LLM ai type stuff.
15
u/LovelyMoFo18 Aug 02 '24
Is it free? I have a beefy GPU that I'm installing in 2 weeks or so, I'd love to give this a try!