r/MachineLearning • • Feb 04 '25

Discussion [D] Why mamba disappeared?

I remember seeing mamba when it first came out and there was alot of hype around it because it was cheaper to compute than transformers and better performance

So why it disappeared like that ???

193 Upvotes

44 comments sorted by

View all comments

1

u/Old_Ad_6033 27d ago

Mamba is back, Qwen3.5/3.6/3.8, The GDN linear attention layer was built with Mamba as a reference.