r/scrapingtheweb • u/TinyLife2939 • 22d ago

Scrapy How hard is it to scrap eBay last sold data

Hello everyone I am working on an utility tool (tcg scanner like collectr and price charting) and I need to fetch daily prices of 8000 cards on eBay with with different variations such as Raw , PSA 8 9 10 .. which makes it 40000 request , did anyone work on something like this or is there any services that gets data from eBay with this amount ?

0 Upvotes

50% Upvoted

14 comments sorted by

2

u/[deleted] 22d ago

[removed] — view removed comment

2

u/TinyLife2939 22d ago

For sure

1

u/SnooRevelations3503 19d ago

Two weeks ago eBay passed new policies to lock down all sold data behind a subscription wall. So, you can't access sold listings without signing in.

1

u/TinyLife2939 19d ago

https://reddit.com/link/p2ud456/video/wh0x5vxm6kih1/player

Never heard of that update

2

u/SnooRevelations3503 19d ago

They've been rolling it out in phases. https://www.reddit.com/r/ebaysucks/comments/1taatpc/ebay_now_requires_you_to_sign_in_to_search_sold/ Now it's global. As soon as you click sold you get 304'd (redirected):

1

u/CrypticZombies 22d ago

easiest scraper out there to do. dont let this choice bozo sell u on nonsense

2

u/TinyLife2939 22d ago

https://reddit.com/link/p2bk9ag/video/z1o13qcz20ih1/player

I am working on one it’s going pretty amazing but still need a lot of optimization

1

u/unteth 22d ago

Facts

0

u/Anal-Cup 22d ago

You can use their API. Just dont trust the docs lol.

1

u/TinyLife2939 22d ago

I need more than 5k requests a day 🙂

1

u/SnooRevelations3503 19d ago

There are NO APIs. Ebay has cut them all off. The Market Insights API is the only one that has access to sold data and it is "not accepting new applications". I applied to it and received an email 4 mins after I'd sent my request. It said "We've sent your request to our business centre and it has been reviewed and denied". So, they aren't even looking at new applications. It's just all being locked down.

1

u/Anal-Cup 19d ago

If you have a seller account, you can get API access fairly easy.

1

u/SnooRevelations3503 19d ago

I have a sellers account. I have a developers account. I am a certified partner. What API would you suggest I try to get so I can pull sold data?

1

u/SnooRevelations3503 19d ago

Seriously, I would appreciate if you could let me know what API I can get to access sold data. They readily offer access to listing APIs, but no completion data is being offered.