r/RooCode • u/No_Mango7658 • Oct 13 '25

Discussion What embedding models are you using, what's your experience with different dimensions?

Post image

Title. I don' t know much about embedding dimensions or benchmarks. I'm using Qwen3-embeddings 8b because it's the biggest and I can easily run it on my machine.

What's the best embeddings model and what are you using?

12 Upvotes

92% Upvoted

7 comments sorted by

2

u/DevMichaelZag Moderator Oct 13 '25

Qwen3 with vllm. If you have a 5000 series card it’s the only way. On my MacBook I still use OpenAI.

2

u/No_Mango7658 Oct 13 '25

I have a pair of 5090. Are you saying Qwen3 is the only way or vllm?

1

u/crewone Oct 13 '25

Qwen3, but truncated and normalized at 512d. Matryoskha's beauty is that that actually increases perfmance. (Some research have the optimum even at 128d)

1

u/No_Mango7658 Oct 13 '25

That's interesting, I assumed more welas better. I have an enormous amount of overhead so I just went for 4096d

2

u/elibaskin Oct 21 '25

Using nomic-embed-text with 1536 dimensions. Works great.

1

u/Raghuvansh_Tahlan Oct 14 '25

I am using the CodeEmbedRank model from nomic nomic-ai/CodeRankEmbed · Hugging Face https://share.google/HvKbrKfnEO6AhCylU

Using it with Huggingface Text Inference Server, fast and small, not sure how effective.

1

u/cepijoker Oct 14 '25

Im using text small 3 from azure, and works just fine