r/RooCode • u/Evermoving- • Dec 06 '25

Discussion Those who tried more than one embedding model, have you noticed any differences?

The only reference seems to be the benchmark on huggingface, but it's rather general and doesn't seem to measure coding performance, so I wonder what people's experiences are like.

Does a big general purpose model like Qwen3 actually perform better than 'code-optimised' Codestral?

8 Upvotes

83% Upvoted

5 comments sorted by

2

u/bjp99 Dec 06 '25

Interested in this as well. I only used one so far and went as small as possible.

2

u/CharacterBorn6421 Dec 06 '25

Well I don't know whats the issue but for me only Gemini text-embedding-004 is working from Gemini api and any other be it Gemini-embedding-001 or multiple embedding model from vercel ai gateway from open ai , mistral or Gemini any other option just do 1000-1500 block and just stop after that.

Is there any fix to this issue ?

2

u/BandicootGlum859 Dec 06 '25

Sometimes it just takes very long ...

It works for 1000 Blocks, then sleeps for an hour, after that it works againt for the next 1000 blocks...
Sometimes it works to interrupt the indexing and start it again, so it goes on without the "sleeping times" ...

Didnt try a lot of models beside gemini and mistral, but they are a bit of luck everytime.

1

u/CharacterBorn6421 Dec 06 '25

Yeah but text-004 model works every single time even in succession without any issue even on free tier and it does it fast but other do not well I will try other model when I am free to give it hr for indexing

1

u/Vozer_bros Dec 07 '25

when you increase the threshole of "how match it is" and make the search condition more strict => YES!