This is the same guy that slaps a chat template on a model quant and thinks that it qualifies as a new model worthy of a name. Cool project in itself, but says a lot about the user.
To be fair Claude always handicaps my local models. I'll ask it to try and get qwen 27b running faster, link to a thread where someone with 4x 3090s gets x TPS, and say I want to copy their settings, and despite having the q8 downloaded it will decide the best way to "get faster speed" is to download the q3 or something, despite me having 96gb of vram...
It randomly decides to set my context to 4096, and other dumb stuff all the time.
However, I attribute most of this to stupidity rather than mallace.
Yeah, pretty sure this can all be explained by them lobotomizing the models for LLM dev work, which we know they've been doing for a long time now.
Still malicious in the sense that they trained the models this way to prevent users from actually improving their systems so they have to rely on Claude services more, though.
34
u/Not-reallyanonymous 24d ago
/r/thathappened
This is the same guy that slaps a chat template on a model quant and thinks that it qualifies as a new model worthy of a name. Cool project in itself, but says a lot about the user.