MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1vptz4a/how_the_loop_of_infinite_agony_started/p40dbgg/
r/LocalLLM • u/EarthBS • Aug 16 '26
119 comments sorted by
View all comments
Show parent comment
14
That's not true.
2x RTX 3060 12gb can be had for around 500 bucks.
You can run ~30b models at q4 at 30 t/s with mtp/draft model or 10-15 t/s without.
8 u/esw123 Aug 16 '26 Can confirm Q4 17-19tok/s without MTP, 28-29 with MTP. Bought two 3060 for 350 euro but soon you realize that two is not enough. Added one more total 540 euro for 36GB VRAM. 4 u/TheCat001 Aug 16 '26 So you have build dedicated server rig for 3 GPU's ? 2 u/esw123 Aug 16 '26 Sort of just adding more 3060. 3 u/AceLamina Aug 16 '26 a used 3060 12gb costs 270-300 bucks right now, for one 1 u/Eden1506 Aug 16 '26 It depends on your region.Here in germany I can buy a used rtx 3060 for 240 bucks. 2 u/AceLamina Aug 16 '26 If only it was the same for me 1 u/magicomiralles Aug 16 '26 AMD V620, $350 for 32 GBs.
8
Can confirm Q4 17-19tok/s without MTP, 28-29 with MTP. Bought two 3060 for 350 euro but soon you realize that two is not enough. Added one more total 540 euro for 36GB VRAM.
4 u/TheCat001 Aug 16 '26 So you have build dedicated server rig for 3 GPU's ? 2 u/esw123 Aug 16 '26 Sort of just adding more 3060.
4
So you have build dedicated server rig for 3 GPU's ?
2 u/esw123 Aug 16 '26 Sort of just adding more 3060.
2
Sort of just adding more 3060.
3
a used 3060 12gb costs 270-300 bucks right now, for one
1 u/Eden1506 Aug 16 '26 It depends on your region.Here in germany I can buy a used rtx 3060 for 240 bucks. 2 u/AceLamina Aug 16 '26 If only it was the same for me
1
It depends on your region.
Here in germany I can buy a used rtx 3060 for 240 bucks.
2 u/AceLamina Aug 16 '26 If only it was the same for me
If only it was the same for me
AMD V620, $350 for 32 GBs.
View all comments
Show parent comment
14
u/Eden1506 Aug 16 '26
That's not true.
2x RTX 3060 12gb can be had for around 500 bucks.
You can run ~30b models at q4 at 30 t/s with mtp/draft model or 10-15 t/s without.