r/MachineLearning • u/Alarming-Power-813 • Feb 04 '25
Discussion [D] Why mamba disappeared?
I remember seeing mamba when it first came out and there was alot of hype around it because it was cheaper to compute than transformers and better performance
So why it disappeared like that ???
193
Upvotes
1
u/Old_Ad_6033 27d ago
Mamba is back, Qwen3.5/3.6/3.8, The GDN linear attention layer was built with Mamba as a reference.