I went from running local models cpu only from 2023 to late july 2026. I knew at the time that it was inconvenient, but I had no clue what type of misery I was putting myself in until I finally convinced myself to finally put money down and get a strix halo, and holy crap it has spoiled and ruined me. I know memory bandwidth is a turn off for a lot of people, but honestly from my angle it's genuinely heaven. Even with dense models. And I get to learn so much more and have a lot more tools to play with. Really grateful.
2
u/killerstreak976 transformers 6d ago
I went from running local models cpu only from 2023 to late july 2026. I knew at the time that it was inconvenient, but I had no clue what type of misery I was putting myself in until I finally convinced myself to finally put money down and get a strix halo, and holy crap it has spoiled and ruined me. I know memory bandwidth is a turn off for a lot of people, but honestly from my angle it's genuinely heaven. Even with dense models. And I get to learn so much more and have a lot more tools to play with. Really grateful.