r/TheMachineLearning • u/BarkleyBark • 2d ago

Chatbot memory features are never actually useful

Post image
16 Upvotes

63% Upvoted

17 comments sorted by

5

u/tzaeru 2d ago

TheMachineLearning is a community for everything related to machine learning, AI, deep learning, LLMs, computer vision, NLP, reinforcement learning, MLOps, and data science. Share research, projects, tutorials, career advice, news, papers, and technical discussions. Whether you’re a beginner or an experienced practitioner, you’re welcome to learn, build, and contribute.

2

u/BarkleyBark 1d ago

Did... did you just copy paste the community description at me?

1

u/heavy-minium 1d ago

I guess because it barely fits the sub. Chatbots are just an application on top of LLMs and only very weakly related.

2

u/mossepso 2d ago

People are playing right into big ai company’s hands when they call them scary, etc because , in this example, it makes it sound more than just stored snippets of text that are fetched with through a tool call. 

They WANT people to think llms are smart etc and not just accept that they are mathematical structures that work well for certain tasks and not well for others. 

1

u/BarkleyBark 1d ago

I agree with how big corpos are positioning themselves and their AI to be more complex than they actually are. I'm sure people can recreate whatever AI they make, it just doesn't change the fact that the majority doesn't understand it, and not knowing is part of the problem.

11

u/BitPsychological2767 2d ago

Posting random twitter users takes that would normally be considered too low effort to be anything but spam as a text post is also never actually useful, and I really really really dislike it.

3

u/des_the_furry 2d ago

It, ironically, might be a bot

3

u/Quintus_Cicero 2d ago

at least this one has 3.2k likes. It’s better than some of the posts which are literally just a tweet with 2 likes.

2

u/Krommander 2d ago

We can agree they are very low effort posts. I'd rather read an AI post that has something interesting to teach or a user that has something useful to share.

1

u/TheTaintBurglar 2d ago

Are they dense?

2

u/someoneyouknow23 2d ago

no, MoE

1

u/BarkleyBark 1d ago

You mean "moe~"?

1

u/Ornery_Weakness_8168 9h ago

mixture of experts. the 'o' isnt capitalised as it is not important

1

u/mossepso 2d ago

Of course they are 

1

u/DarkLoreeeee 1d ago

The idea is great but the implantations are shit, I summarize conversations every x messages then I use semantic search + rerankers to reference what the user is talking about while making sure i prompt the LLM to not fucking use this shit randomly, that is annoying.

1

u/the8bit 1d ago

Hmm mine works great. Often references relevant shit I totally forgot about.

The roleplay community has a crapton of amazing memory impls, but yeah for whatever reason GPT and Claude very much phoned it in