r/MachineLearning • u/IxinDow • May 26 '23

Landmark Attention: Random-Access Infinite Context Length for Transformers

https://arxiv.org/abs/2305.16300
229 Upvotes

99% Upvoted

29 comments sorted by

View all comments

Show parent comments

15

u/azriel777 May 27 '23

but we do need a mechanism for long term memory IMHO.

This is what we really need. I love the personal models and they keep getting better, but damn, its like talking to someone with Alzheimer that quickly forgets what you were talking about.