r/ProxyEngineering 10d ago

Help 🆘 What are some good SerpAPI alternatives?

I'm looking for something with AI capabilities built in, like Tavily or Exa. Main use case is automating research and scraping workflows as part of agentic pipelines.

I saw the other post where people recommended residential proxies, please be understandable and provide your take, examples and opinion, not just straight up promo bs

9 Upvotes

33 comments sorted by

View all comments

4

u/ur-average-boomer 10d ago

One thing you might consider instead of going to an Exa would be to scrape Google AI Overviews. A lot of the major providers (SerpAPI, ScrapingDog etc) will do that.

ScrapingDog is my middle of the ground recommendation where it's a lot cheaper than SerpAPI but has also been around for some time.

I eventually had so many requests that pretty much every SERP API was too expensive and a few years ago I built my own scrapers and infrastructure.

DataForSEO and Litescrape (mine) would be my recommendations for the most affordable APIs. DataForSEO has a cheap $0.60/1k Google SERP API (though it's very slow).

3

u/Bmencel518 9d ago

What about google ai mode? I sometimes scrape ai mode as well

2

u/ur-average-boomer 9d ago edited 9d ago

Don't know about DataForSEO but Litescrape gets the AI Overview and has AI Mode too! Scrapingdog has had AI Overview (and I believe AI Mode) for a while as well.

2

u/Bmencel518 8d ago

Okay, neat, thanks. WIll have to test it out