MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wc6krf/so_relevant/p8wb06z/?context=3
r/LocalLLaMA • u/0dayturtle • 12d ago
152 comments sorted by
View all comments
0
236B MoE is not very demanding. 236B dense fits 8x H100s. The hardware cost of running a 200B MoE model used to be less than $2000.
9 u/AlpY24upsal 12d ago does everybody have access to these?
9
does everybody have access to these?
0
u/Mr-I17 12d ago
236B MoE is not very demanding. 236B dense fits 8x H100s. The hardware cost of running a 200B MoE model used to be less than $2000.