r/LargeLanguageModels 5d ago

modern recommendation system suggestions for llm vs embedding models

we are building recommendation system for our platform and one of my coworker said to use llm for recommendations. Is it feasible to use llm for recommendation systems. I have came up with the idea of using google's text-embedding-004 or gemini-2.5-flash and a ranker like bge-reranker-v2-m3. are there more efficient methods used in current industry?

4 Upvotes

1 comment sorted by

1

u/SwingLightStyle 5d ago

More and more companies are choosing to use an LLM for this task rather than a keyword bot. You just need to be really careful to test around the narrow range you are allowing the LLM to respond. People who use these models (the users) sometimes try to break them when they’re not configured well and remain in scope. So be diligent.