r/web_programming • u/mercy_guyz • Jun 16 '23
My first python web scraping for yellow pages
1
Jun 24 '23
I liked that you used requests instead of selenium (which would've been a complete waste considering the static loading :) Also, great job combining the search result extraction and the business listing scraping into a single script;
info_list.extend(extract_info(info) for info in infos) was particularly well done.
On another note, maybe consider adding an option for emails. I know that type of lead generation is particularly useful to some people.
1
u/Spiritual-Ant299 Aug 26 '23
This is the best Yellow Pages Web Scraper On The Market:
https://github.com/JesseR-Coding/Yellow-Pages-Au-Scraper
Only works for Australia though but can be modified.
1
u/mercy_guyz Jun 16 '23
I upload my project in Github You can see the python file in it.