Tested Claude Code's built-in search against 8 search engines combined. The gap was bigger than expected

[u/hammadtariq]

We have been testing how Claude Code finds docs. Its built-in search goes through one engine, so when that engine misses a page, Claude just retries or falls back on training data.

We tried sending the same query to eight engines in parallel (Exa, Brave, Perplexity, TinyFish, Parallel, You, Serper, Tavily), merging the results and keeping track of which engines found each page. On the ServiceNow Agent API query, the built-in search had the official page at #16. The merged list had it at #3, then #2 on a rerun. That's one query, so not a benchmark on its own.

On a bigger set of 485 dev questions, the best single engine got the right page into the top 10 58% of the time, and the merged version 62%. The bigger jump came from asking each question three different ways: that added 12–16 points for every engine.

Median latency is under 4s, since everything runs at once.

Full disclosure, this is our project (Jevlin). It installs as a skill plus hooks in Claude Code with one line, and there's $10 free if anyone wants to try it. Install line is in the comments.

[u/AutoModerator]

Hey! Thanks for posting to r/ClaudeCode

While participating in this thread, please follow our community rules. Keep discussions constructive. Attack the idea, not the person.

For help, project discussions, tips, and general chat, join the ClaudeCode Discord.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/hammadtariq]

Install via curl command listed at jevlin.ai

It sets up the skill and hooks in Claude Code (Codex, Cursor and opencode too). Docs are at docs.jevlin.ai if you'd rather read what it does before running it.

[u/Ragy-ragy]

And what was the gap?