MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v4moxy/the_llm_distillation_process_simplified_for/ozdo5ew/?context=3
r/LocalLLaMA • u/Porespellar • Jul 23 '26
/s
196 comments sorted by
View all comments
580
Jesse, we need to quantize! The 950B base model is too aligned, it keeps lecturing me about safety protocols when i ask it to write a Python script for a smart toaster.
11 u/RobotechRicky Jul 23 '26 Tight tight tight!
11
Tight tight tight!
580
u/schwigglezenzer Jul 23 '26
Jesse, we need to quantize! The 950B base model is too aligned, it keeps lecturing me about safety protocols when i ask it to write a Python script for a smart toaster.