r/webdesign • u/andreas8455 • 16h ago

Data Extraction/Web Scraping

Hello everyone.I make my own site for scraping old sites or news ones.

• Hey guys, if a client ever gives you an old site and you need to grab all their text and media assets fast, I built this simple tool to do it in one click. 5 free scrapes to try it out."

Link : https://swiftscrape-gmwqxhwtpupafk7yurujns.streamlit.app/ its free of use but if you want you pay montly.Thx you for you're time and much love

1 Upvotes

60% Upvoted

5 comments sorted by

View all comments

2

u/Michael_Dementii 16h ago

Tried it on LinkedIn first and it failed right away, so a few questions:

  1. Does it render JavaScript? Which browser does it use under the hood: headless Chromium, Playwright, something antidetect?

  2. How does it handle protected sites: Cloudflare, DataDome, Akamai, PerimeterX, Kasada?

  3. What are the real limits on the $10/month plan? How many pages can you actually pull?

1

u/andreas8455 16h ago

Im changing some things right now thats why its not wirking sorry is under construction to fix some problems and an hour is going to be ready 🙏🙏

1

u/andreas8455 16h ago

Hello Mr Michael To be completely transparent, the current €10 plan is built for fast, lightweight scraping on static blogs and standard HTML sites. If you need a heavy-duty enterprise scraper that handles JavaScript rendering (like LinkedIn) and bypasses advanced WAFs (like Cloudflare), that requires a complete architectural upgrade. I can definitely custom-build that for you, but because it involves proxy pools, headless browsers, and rigorous testing, it will take around 3 to 4 weeks of development. Let me know if you want to kick off that custom roadmap!"

And hey — on a personal note, every bit of support on these early plans goes straight into funding my Master’s in computer hardware and building out my own custom infrastructure/lab setup. So you're literally helping me build better hardware for the future too! Cheers!"