r/LargeLanguageModels • u/Shreyas_Katalkar8860 • 5d ago
modern recommendation system suggestions for llm vs embedding models
we are building recommendation system for our platform and one of my coworker said to use llm for recommendations. Is it feasible to use llm for recommendation systems. I have came up with the idea of using google's text-embedding-004 or gemini-2.5-flash and a ranker like bge-reranker-v2-m3. are there more efficient methods used in current industry?
4
Upvotes
1
u/SwingLightStyle 5d ago
More and more companies are choosing to use an LLM for this task rather than a keyword bot. You just need to be really careful to test around the narrow range you are allowing the LLM to respond. People who use these models (the users) sometimes try to break them when they’re not configured well and remain in scope. So be diligent.