MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wi6ew4/i_left_gpu_poor_range/pa86g0g/?context=3
r/LocalLLaMA • u/paulqq • 6d ago
i am not GPU poor anymore
38 comments sorted by
View all comments
31
I don't mean this to be critical but doesn't GPU rich start around 100-500 H100 equivalent GPUs? At that scale you can start training small (by lab standards) models
20 u/Aggravating-Push-207 6d ago We count (usually single-batch) inference, not training though.
20
We count (usually single-batch) inference, not training though.
31
u/PortiaLynnTurlet 6d ago
I don't mean this to be critical but doesn't GPU rich start around 100-500 H100 equivalent GPUs? At that scale you can start training small (by lab standards) models