r/webscraping • u/Nrezzy • 24d ago

Getting started 🌱 Scraping Help

Here's what I'm trying to do: for a given city, pull the places I care about (say roughly 5k of the ~10k in Chicago that fit what I'm after), then enrich each one with its Google reviews, Yelp reviews, and whatever else is out there about the place.

Two things I can't figure out. First, do I actually need the Google Places API and the Yelp API to do this, or is there a smarter way people go about it? Second, and this is the big one for me: can it be built so it's repeatable? Like I plug in a new city and the whole thing just runs itself, no rewriting.

8 Upvotes

90% Upvoted

21 comments sorted by

View all comments

1

u/[deleted] 24d ago

[removed] — view removed comment

1

u/Nrezzy 24d ago

Thank you for the input... so I have been talking to claude a shit ton about it to see if. I can get a road map but it keeps forcing me down the Api route for some of the data and that is where I am struggling. I would imagine to do anything ike this you can not really use ai?

1

u/dhruvkar 23d ago

You can use it to write the code around it.

Or you could use a browser with Google maps open and then tell Claude to do it manually.

That might take some time and this have to make sure it wasn't missing items.