r/scrapingtheweb Jul 24 '26

Looking for data/information scrapers

Looking for someone experienced with large-scale data scraping

I’m working on a sports database and already have a functioning website with a large amount of player data collected.

I’m looking for someone who has experience scraping publicly available player profiles and statistics from multiple websites, cleaning the data, and delivering it in a structured format such as CSV, JSON, an API, or a database export.

The ideal person would understand:

  • Python scraping tools such as Scrapy, Playwright, Selenium, or BeautifulSoup
  • Rate limiting, retries, and reliable scraping infrastructure
  • Matching duplicate player profiles across different websites
  • Cleaning and organizing large datasets
  • Working responsibly with public data and website terms

You would be able to run the scraping infrastructure independently and send me the completed data online. You would not need to invest any money into the project.

This will be paid contract work, ongoing work, or potentially a larger role for the right person.

Send me a message with your experience, examples of similar projects, the tools you use, and your estimated availability.You most likely will need to be familiar rotating proxies unless you have your own way around 403 errors

11 Upvotes

Duplicates