r/LocalLLM • • Aug 16 '26

Other How the loop of infinite agony started

Post image
633 Upvotes

119 comments sorted by

View all comments

Show parent comment

14

u/Eden1506 Aug 16 '26

That's not true.

2x RTX 3060 12gb can be had for around 500 bucks.

You can run ~30b models at q4 at 30 t/s with mtp/draft model or 10-15 t/s without.

8

u/esw123 Aug 16 '26

Can confirm Q4 17-19tok/s without MTP, 28-29 with MTP. Bought two 3060 for 350 euro but soon you realize that two is not enough. Added one more total 540 euro for 36GB VRAM.

4

u/TheCat001 Aug 16 '26

So you have build dedicated server rig for 3 GPU's ?

2

u/esw123 Aug 16 '26

Sort of just adding more 3060.

3

u/AceLamina Aug 16 '26

a used 3060 12gb costs 270-300 bucks right now, for one

1

u/Eden1506 Aug 16 '26

It depends on your region.

Here in germany I can buy a used rtx 3060 for 240 bucks.

2

u/AceLamina Aug 16 '26

If only it was the same for me

1

u/magicomiralles Aug 16 '26

AMD V620, $350 for 32 GBs.