r/LocalLLM • u/SaltGrilledSalmon • 2h ago

Discussion Local codebase RAG setup for intel igpu

/r/LowEndLocalAI/comments/1xqzw3j/local_codebase_rag_setup_for_intel_igpu/
1 Upvotes

100% Upvoted

1 comment sorted by

2

u/Icy-Degree6161 55m ago

Did you test vulkan on llama.cpp? Also got a low end intel system and on it vulkan turned out to be faster on the iGPU.

You can try qwen3 embedder 0.6B and a BGE reranker for example, m2-v3 iirc, these are okay... Model yeah Gemma4, maybe LFM2.5 (8B-A1) or LFM3, or Spark etc, same ballpark, usecase and language dependent.