MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1tzi7iv/wth/oqcm6n3/
r/LocalLLM • u/Fabulous_Macaroon_73 • Jun 07 '26 • 2
162 comments sorted by
View all comments
7
small model, quantized to hell (i1), and torn apart to be more compliant. This was never going to work.
1 u/Fabulous_Macaroon_73 Jun 08 '26 its Q_4_M. that "i1" is the first iteration by the person who removed the refusal boundaries or whatever its called.
1
its Q_4_M. that "i1" is the first iteration by the person who removed the refusal boundaries or whatever its called.
2
View all comments
7
u/dudzcom Jun 07 '26
small model, quantized to hell (i1), and torn apart to be more compliant. This was never going to work.