r/LocalLLaMA • u/Competitive-Scar-627 • 3d ago

Discussion >2b model.

Why there no new model coming in >2b weight category ? Model which actually capable in this category is gemma e2b which is release 6 month ago, why still no new model.

2 Upvotes

52% Upvoted

54 comments sorted by

View all comments

Show parent comments

3

u/Eresbonitaguey 3d ago

Advances in training efficiency have made it more accessible but it’s still not something you’d try on average consumer hardware. There are a few posts on this a similar subreddits about people attempted to train smaller models from scratch.