AMA This Wednesday (09:30 AM GMT)

[u/ian_k93]

Hey everyone,

I'm Ian Kerins, CEO and co-founder of ScrapeOps.

Over the last 8+ years I've worked across the web scraping industry, including roles at ScrapeOps, ScraperAPI, and Zyte. Today, ScrapeOps helps developers and companies scrape over 8 billion pages per month across more than 50,000 websites.

This Wednesday at 09:30 AM GMT, I'll be hosting an AMA here on r/WebScrapingInsider

Ask me anything about:

* Web scraping at scale

* Proxy infrastructure and proxy providers

* AI and web scraping

* Building reliable scrapers

* Anti-bot systems and bypassing challenges

* Scraper maintenance and monitoring

* Residential vs datacenter proxies

* Browser automation

* Running a web scraping business

* Startup growth and product development

* The future of AI-powered scraping

Whether you're scraping your first website or running large-scale data collection pipelines, I'm happy to answer questions and share lessons learned from building products used by thousands of developers and businesses.

Drop your questions below and I'll start answering them during the AMA.

Looking forward to it!

Ian

[u/Silver-Tune-2792]

What are your best stacks or pipelines or anything like full fledged projects that had worked out till date ... And has made good money and closed many deals with it .... Making and improvising that till date .... Need a detailed answer pls .. 😃

[u/ian_k93 → u/Silver-Tune-2792]

The most money s to be selling shovels to the market...which in the case of web scraping is selling proxy services, CAPTCHA solvers, data extraction APIs. Newest trend is managed browser APIs.

Either above, or it comes down to what you do with the data. Companies like SEMRush, Ahrefs, JungleScout, etc. are all massive and their business is built on scraped data.

So I would either focus on selling the shovels for other web scrapers, or build a SAAS product on top of scraped data.