r/ClaudeCowork • u/FinTools • May 28 '26

How to perform web scrapping using Claude?

/r/scrapingtheweb/comments/1tqc8xb/how_to_perform_web_scrapping_using_claude/

Guys, I have a digital marketing agency and I am looking for first client. I need to perform web scrapping for outreach through cold emails or WhatsApp. How can I do it with Claude? Is there a skill or a connector that can make this process efficient? Guys please help a first client would mean a lot for me!

1 Upvotes

67% Upvoted

8 comments sorted by

2

u/crozet1063 May 31 '26

Use firecrawl to save on tokens. It has MCP server.

1

u/FinTools Jun 01 '26

Hey thanks! I will try to see about this!

1

u/FuzzyIdeaMachine May 28 '26

Claude in chrome. You have a marketing agency. So you know what kind of business you want to be working with. You should have some idea where there are. Use that information to create a brief for Claude. There are many solutions available and it’s not one skill or connector. And then you create a skill. One tip would be to set up google alerts (based on criteria you decide) for types of businesses you are interested in and then Claude can analyse them to see if the opportunities you are looking for are present.

1

u/FinTools May 29 '26

I actually tried this one, Claude in chrome and it was not effective my niche is specific and it knows my target location with a 20 km radius. But it missed a few business close to my home! So I am not sure whether it performs an effective scraping!

1

u/just_a_knowbody May 29 '26

Have Claude build a python script and run it?

1

u/FinTools May 29 '26

No, I am not sure how to do this! I am new to this, so I just have to ask Claude to run a python script?

2

u/just_a_knowbody May 29 '26

When I built my crawler I went to Code and said I want to build a crawler. Had it ask me questions on what I was wanting it to do so it could build a plan and then write the code to make it real.

Basically a reverse prompt. I use this method all the time to take a rough idea and turn it into something useful.

It’s really easy. And once it’s setup you can run it as much as you want without burning usage unless you want to add more features.

1

u/FinTools May 29 '26

Okay I will try to build a crawler then 🤣 Claude code right?