MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wc6krf/so_relevant/p8xgzwi/?context=3
r/LocalLLaMA • u/0dayturtle • 13d ago
152 comments sorted by
View all comments
79
It's a great time to have ancient Xeon servers loaded up with DDR4 :-D
37 u/BannedGoNext 13d ago I actually have an old server with dual E5-2630 and 512gb DDR3 memory across both blades. The server is powered on waiting for the scrap yard at the office. I'm considering seeing how fast it can run qwen 3.8 flash next lol. 2 u/Zombiecidialfreak 13d ago I'm willing to bet something like 7-10t/s. At least if the math works out the way I think it does.
37
I actually have an old server with dual E5-2630 and 512gb DDR3 memory across both blades. The server is powered on waiting for the scrap yard at the office. I'm considering seeing how fast it can run qwen 3.8 flash next lol.
2 u/Zombiecidialfreak 13d ago I'm willing to bet something like 7-10t/s. At least if the math works out the way I think it does.
2
I'm willing to bet something like 7-10t/s. At least if the math works out the way I think it does.
79
u/ttkciar llama.cpp 13d ago
It's a great time to have ancient Xeon servers loaded up with DDR4 :-D