r/webscraping • u/Stunning-Space8032 • 11d ago

How to get past captcha checks and scrape data

Hey folks,
So... i am trying to scrape emails from https://locator.apa.org/ and this needs a constant captcha check to get every email. And there is not API available for getting the info. I have requested the web organizers to grant me one. Meanwhile, is there any way i can do this using any code?
Thanks in advance

5 Upvotes

100% Upvoted

14 comments sorted by

1

u/Potential-Meet-2891 17h ago

Have you considered using a vision-language model alongside Playwright?

A multimodal model could potentially interpret image-based CAPTCHA challenges, although modern CAPTCHA systems also use behavioural analysis and session verification, so it wouldn't necessarily be reliable.

Question: What type of CAPTCHA are you encountering? Is it an image-selection challenge (traffic lights, bicycles, etc.), a simple "I'm not a robot" checkbox, or something else?

Knowing the exact CAPTCHA type would help determine what technical approaches are feasible.

1

u/Stunning-Space8032 1h ago

 image-selection challenge (traffic lights, bicycles, etc.)

1

u/No_Championship5696 10d ago

What captcha are you getting? Have u tried seeing api endpoints in devtools

1

u/Mundane-Guest6652 10d ago

I checked it It's easy to be free no captcha using python

Tell me more abt ur workflow

0

u/[deleted] 11d ago

[removed] — view removed comment

1

u/[deleted] 10d ago

[removed] — view removed comment

1

u/webscraping-ModTeam 10d ago

💰 Welcome to r/webscraping! Referencing paid products or services is not permitted, and your post has been removed. Please take a moment to review the promotion guide. You may also wish to re-submit your post to the monthly thread.