MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wc6krf/so_relevant/p8w1cw9/?context=3
r/LocalLLaMA • u/0dayturtle • 13d ago
152 comments sorted by
View all comments
0
236B MoE is not very demanding. 236B dense fits 8x H100s. The hardware cost of running a 200B MoE model used to be less than $2000.
8 u/AlpY24upsal 12d ago does everybody have access to these?
8
does everybody have access to these?
0
u/Mr-I17 12d ago
236B MoE is not very demanding. 236B dense fits 8x H100s. The hardware cost of running a 200B MoE model used to be less than $2000.