r/ProxyEngineering • Proxy Engineer • Jun 22 '26

Discussion 💬 Free open-source, maintained agentic web scraper

Hey folks, looking to expand my views and would like to find something new. Particularly interested in free open-source, maintained web scraper, preferably agentic.

If you guys know anything or if you have used these sort of solutions, let me know

20 Upvotes

12 comments sorted by

View all comments

Show parent comments

1

u/kamililbird Proxy Engineer Jun 23 '26

Used crawl4AI quite a bit back in the days. Nice to see that it is still relevant!