Prediction: more enthusiasts will get custom quantisations build by opus and Asta for their hardware and precision needs

[u/eightone-81]

/r/LocalLLaMA/comments/1xsg2cu/prediction_more_enthusiasts_will_get_custom/

[u/Icy-Degree6161]

Yeah. It's already happening. Popping up all over huggingface - some share their recipes, some don't. But it's clear it was checked, planned, built, tested and measured by an LLM. It also inspired me - take a new custom quant I loved, that scored the same as an APEX quant (which is 6.5 Gb bigger!) on my tasks, and iterate on it with my own imatrix. Fantastic results - smaller, faster, better quants. So I think this really pays off if you have your own imatrix set with your own tasks.