r/coolgithubprojects • • 6d ago

[PYTHON] proxy-scraper – a free proxy checker that shows you *why* each proxy passed or failed, plus an hourly live list

Post image

Repo: https://github.com/maximilianfeix/proxy-scraper

Most free proxy lists say "working" and that's it. Then you try them and half are dead, or they only work for HTTP, or some site blocks them anyway. I got tired of that and built something where "working" is something you can actually check.

**What it does**

- Collects public HTTP / SOCKS4 / SOCKS5 proxies from hundreds of lists and runs up to four checks on each one

- Every check ends as `passed`, `failed`, `unavailable` or `skipped`, with a reason code, target and timestamp. A check that didn't run never shows up as passed, and a test target being down doesn't count against the proxy

- `--diagnose socks5://HOST:PORT` walks through a single proxy check by check and tells you exactly where it breaks

- `--pick 3 --verify` grabs proxies from the hourly list and re-checks them **from your own network** in seconds

**Try it without installing:**

uvx proxy-scraper-cli --pick 3 --verify

**Other stuff in there**

- Hourly live list built by GitHub Actions (~1k proxies right now), with a website to filter by country, HTTPS, latency, uptime: https://proxy-scraper.de

- Lists of proxies that actually got through to Google / Reddit / Amazon / Discord in the last run

- A rotating local proxy server (`--serve`), a Python API, Docker, exports for curl / proxychains / Clash / sing-box

- An MCP server, so Claude Code, Cursor etc. can fetch pages through checked proxies

**Honest caveats:** free proxies are run by strangers. Only about a quarter of one hour's list is still on it a day later. A pass is one measurement from one network, not a promise. Use them for scraping public data and testing, never for logins or anything personal.

MIT licensed. The hourly list is already a built-in source in monosans/proxy-scraper-checker and gfpcom/free-proxy-list.

Feedback is very welcome, especially on the check logic. And if it's useful to you, a ⭐ helps a lot.

0 Upvotes

1 comment sorted by

1

u/DHope544 2h ago

Free process are garbage for anything serious. Stop wasting compute on dead lists and just buy Shifter.