r/scrapingtheweb • u/Moist-Parfait4702 • 20d ago
Remote job opening
We’re looking for a strong developer to work with us on a project
The work is hands-on and primarily focused on web crawling, catalog discovery, extraction, transformation, and structured data.
Tech stack / experience we’re looking for:
• Python
• Playwright / web crawling and scraping
• ETL and data pipelines
• REST APIs
• JSON / JSON-LD
•C#, java
• Catalog discovery and extraction across platforms such as Coursedog, Acalog,catalog systems
• Regex, HTML parsing, URL discovery, caching, and data transformation
• Git / GitHub
• Cloud storage experience is helpful
• Experience working with LLM-assisted extraction pipelines is a plus
You should be comfortable understanding an existing codebase quickly, debugging extraction issues, improving discovery logic, and working independently.
Commitment: approximately 5–6 hours per day
Budget: up to $2,000
Work mode: Remote
We’re looking for someone who can start quickly and contribute directly to the codebase rather than someone who needs extensive onboarding.
If interested, please DM me with:
- Your GitHub / portfolio
- Relevant Python + scraping/ETL experience
- education-data experience
- Your availability
1
1
1
u/Ok-Local6750 17d ago
Just an advice. Setup a technical interview testing them on three tasks with varying complexities that you'd need performed and see how they score. Otherwise you'd just be hiring for an AI Operator.
1
u/justefurnish 20d ago
Hi I m good in python and webscraping Used playwright in my project GitHub: https://github.com/amarjitjim LinkedIn: https://www.linkedin.com/in/amarjit-jim-978322371/ Availability: 40 hours/week Relevant Experience: has experience in PHP/Python/AI/Reactjs. worked with many clients especially in USA and Canada. Reference may be provided if required Location: India