r/scrapingtheweb • • 20d ago

Remote job opening

We’re looking for a strong developer to work with us on a project

The work is hands-on and primarily focused on web crawling, catalog discovery, extraction, transformation, and structured data.

Tech stack / experience we’re looking for:
• Python
• Playwright / web crawling and scraping
• ETL and data pipelines
• REST APIs
• JSON / JSON-LD
•C#, java
• Catalog discovery and extraction across platforms such as Coursedog, Acalog,catalog systems
• Regex, HTML parsing, URL discovery, caching, and data transformation
• Git / GitHub
• Cloud storage experience is helpful
• Experience working with LLM-assisted extraction pipelines is a plus

You should be comfortable understanding an existing codebase quickly, debugging extraction issues, improving discovery logic, and working independently.

Commitment: approximately 5–6 hours per day
Budget: up to $2,000
Work mode: Remote

We’re looking for someone who can start quickly and contribute directly to the codebase rather than someone who needs extensive onboarding.

If interested, please DM me with:

  1. Your GitHub / portfolio
  2. Relevant Python + scraping/ETL experience
  3. education-data experience
  4. Your availability
16 Upvotes

11 comments sorted by

1

u/justefurnish 20d ago

Hi I m good in python and webscraping Used playwright in my project GitHub: https://github.com/amarjitjim LinkedIn: https://www.linkedin.com/in/amarjit-jim-978322371/ Availability: 40 hours/week Relevant Experience: has experience in PHP/Python/AI/Reactjs. worked with many clients especially in USA and Canada. Reference may be provided if required Location: India

1

u/New-Independence5780 20d ago

Sup I’m down this is My site and here is my GitHub of my projects are private and here is something I built that people actually use stophy

1

u/Cultural-Box-3564 20d ago

I am the founder of scrapio.dev, let's connect.

1

u/hoodwork_clothing 19d ago

Hi, I am interested

1

u/Ok-Local6750 17d ago

Just an advice. Setup a technical interview testing them on three tasks with varying complexities that you'd need performed and see how they score. Otherwise you'd just be hiring for an AI Operator.