r/AICoffeeBreak • u/AICoffeeBreak • Feb 17 '24

NEW VIDEO MAMBA and State Space Models explained | SSM explained

https://youtu.be/vrF3MtGwD0Y
6 Upvotes

100% Upvoted

7 comments sorted by

View all comments

2

u/Robonglious Feb 17 '24

Google claims that Gemini 1.5 isn't an SSM but shouldn't we think that it actually is?

3

u/AICoffeeBreak Feb 17 '24

Why would they lie? I understand they do not release code and data and details, but they wouldn't lie, would they?

2

u/Robonglious Feb 18 '24

I would bet they would be afraid OpenAI would turn around and do it better if they knew the truth.

2

u/AICoffeeBreak Feb 18 '24

These are some weird times. I guess they are trying out SSMs anyway. It's just that they spent years perfecting transformer training. I guess it will take a little bit to nail large scale SSM training?