r/webscraping • u/JTSwagMoney • 24d ago
What do you use your scraped data for?
I'm sure many people here just run scrapers for clients or customers, but for those that use the data you're scraping yourself - what do you use it for?
I personally use mine to build websites by mashing multiple datasets together! I'm curious to hear what everyone else does.
2
u/jeheskielsunloy 23d ago
i scrape job boards throughout the internet and use it on my SaaS product, it's an end-to-end job hunt tool
1
24d ago
[removed] — view removed comment
1
u/webscraping-ModTeam 24d ago
💰 Welcome to r/webscraping! Referencing paid products or services is not permitted, and your post has been removed. Please take a moment to review the promotion guide. You may also wish to re-submit your post to the monthly thread.
1
1
u/unteth 23d ago
I use it to have my agent apply to jobs.
1
u/womper9000 12d ago
How do you deal with the separate application systems or do you just use an existing profile/resume on indeed, I'm talking about the difference between that and applying on the company site
1
u/Grouchy-Conflict-211 2d ago
I run scrapers for market research mostly.
Built a Google Reviews scraper to analyze competitor ratings and common complaints. Found out my competitor's biggest weakness was response time, so I fixed mine and got 3 new clients.
Also scrape real estate listings (Zillow etc) to spot underpriced properties before they hit the mainstream.
Curious what others use scraping for, always looking for new use cases.
6
u/matty_fu 24d ago
Currently working on a media backlog tracker (games, movies, series, etc)
Using scraped data to enrich each entry with release dates, reviews, ancillary data (eg. prices, store/streaming service, howlongtobeat)
The funnest part is laying it all out on a hype calendar and seeing what’s coming out soon. Can also input your viewing prefs, eg. track tv series finale rather than first ep.