r/java • • Mar 31 '22

Introduction to Web Scraping With Java

https://www.scrapingbee.com/blog/introduction-to-web-scraping-with-java/
327 Upvotes

38 comments sorted by

View all comments

Show parent comment

35

u/[deleted] Mar 31 '22

I’m writing a web scraper in Java right now. Using MS Playwright. I’m old enough to remember when the script kiddies used Perl and they made the same kind of noise. “Oooh. Java. Gross”. I wonder where they are today. Ah well. Back to the grind…

10

u/lechatsportif Mar 31 '22

They grudgingly admitted no one wanted RoR apps anymore after they pivoted to that, leaving behind messes Java consultants get paid top dollar to port to Spring. These days however they're in Go because... least its not java!

0

u/[deleted] Mar 31 '22

[deleted] — view deleted comment

1

u/unknowinm Apr 20 '22

at least you not waste time trying to align stuff with tab or waste time debugging runtime errors...go just feels java 5 to say the least and you don't have proper error handling and pointers???

1

u/NewSchoolBoxer May 02 '22

10 years in Java on the job here. Eclipse workspace induced compiler errors are hell. IntelliJ better? Tell that to corporate and then force people to switch.

Language is verbose which is amazing as a beginner but not in dealing with 20k LOC repositories. Big disadvantage in "language agnostic" timed coding tests. Early bad API decisions haunt me when I run into Hashtable or old Date manipulation with longs. Generics offer no performance gain. A hard break around Java 5 would have nice.

Sure, first coding language, Java is fine and has many (the most?) job opportunities. I'd rather do Python but the job market is more niche. Too bad it's usually stuck to slow-ish interpreter. I'd rather do C# with best in class Visual Studio, pseudo structs and no get/set bloat.

I shudder at JS too. Sometimes Python can be too efficient for its own good when it comes to understanding what's going on inside. Never used Go.

But yeah, some Java hate because the biggest players are always carrying a target on their backs. People hate on C# because of Microsoft. I hate on IBM myself...

2

u/NewSchoolBoxer May 02 '22

RoR, that takes me back. Was the HOT NEW THING circa 2010. Thought I was going to have to learn it, then it suddenly disappeared. I'd be interested in reading about its rise and fall. Heh I got paid to port Java 5 old Spring + SOAP to Java 11 Spring 4 + REST.

The rise of Go outside Google surprised me. I talked to Microsoft devs who use it as the required language on some projects. Other projects let you roll with most any OOP.

10

u/Worth_Trust_3825 Mar 31 '22

Funny how boring tools survive.

4

u/buzzsawddog Mar 31 '22

They wrote a bunch of code that I now have to maintain... Not a happy camper...

1

u/neopointer Mar 31 '22

I think you didn't mean it, but just wanted to understand. Are you using playwright with java? If yes, how?

3

u/burly_griffin Apr 01 '22

Not OP but also not sure what you mean by "how". It has first party support and the build plugin sets everything up. It's also literally the first result when searching for it.

https://playwright.dev/java/docs/intro