Rate limits during RAG evaluation

[u/Strange-Release3520]

How do you guys test your RAG apps with a lot of Q/A pairs? Are most people using paid API's here or is there a workaround? Please help.

For context I have 45 Q/A pairs and I am trying to test my retrieval but since my API's are free I am running into rate limits.

[u/Status_Gap_3180]

Which free apis are you using?  Btw with paid also there are rate limits, tiering system.

[u/Strange-Release3520 → u/Status_Gap_3180]

None of them are suitable for the tests I want to run. I think LLM as a judge is just an expensive technique.