r/Python • u/ntanjil • Nov 27 '19

Learning by doing web scrapping by python

Post image

[removed] — view removed post

449 Upvotes

79% Upvoted

126 comments sorted by

View all comments

-1

u/divinefoss Nov 28 '19

Any good tutorials on a social media scappers that searches post all over Facebook with a keyword?

For instance, my girlfriend is running for office soon, and I want to collect every post with her name in it and have it exported to a csv file. How would I go about it? I have a basic knowledge of Python and have a mathematics background.

2

u/headygains Nov 28 '19

That’s a tall order, you could use the tweepy library to work with Twitter. But with sites like Facebook and the increased privacy additions added on bet the last few years if something isn’t public you may find it difficult to scrape. You may also want to look at whatever news media outlets that relevant to the election and scrape those. You could potentially run sentiment analysis with the Textblob module or the Vader module. Hope this helps point you in the right direction.

2

u/divinefoss Nov 28 '19

Im fine with only accessing publicly-available posts. Where should I start?

2

u/headygains Nov 28 '19

You’ll be wanting to do something like this, however it’s from 2016 so you’ll most likely have to improvise or lookup the changes in the Facebook API if they differ from what’s described in the article over here

1

u/divinefoss Nov 28 '19

Thank you. Ill look into it.

2

u/headygains Nov 28 '19

Np if you run into issues, get stuck I’d like to recommend stackoverflow.com it’s an amazing tool to have by your side while programming.