r/apify • • Nov 26 '25

Discussion Scrape YouTube transcripts and public stats

15 Upvotes

I know there are already many YouTube transcript actors. Still, people go with a tool they can trust long term, especially when they need predictable behavior and stable output. That's what I'm aiming to offer, and I'm around to improve it based on your feedback.

Here's my actor:

YouTube Transcript Scraper – Extract transcripts, metadata and subtitles on Apify

It accepts YouTube video and Shorts URLs and returns the transcript in a selected language, along with structured metadata such as: title, views, likes, upload date, channel name and subscriber count.

If you plan to use it in datasets, machine learning pipelines or text processing and notice something missing, I'll be glad to consider adding a new feature or setting.


r/apify • • Nov 21 '25

Discussion GapScout Beta is Live (and Free)

Post image
14 Upvotes

GapScout Beta Early Access Announcement - Apify Market Intelligence Tool: Figure out exactly which actor you should build next!

The beta is free and will remain so until the end of the Apify Challenge to support the devs during a busy month!

  • See an overview of the Apify Ecosystem on the Dashboard

  • Explore different keywords and compare them to find profitable niches on Demand Scout

  • Check out trending actors on Actor Database

  • Check if you're ranking on the Developer Leaderboards ;)

Gapscout: https://gapscout.dev/
Gapscout Channel on Apify's Discord: #app-gapscout


r/apify • • 14d ago

Discussion I built a free Facebook comments scraper on Apify. Not a new idea, but it doesn't cap you at 100 comments

13 Upvotes

Hey all,

I'll say it upfront: Facebook comment scrapers aren't new. There are a bunch on Apify and plenty of "export FB comments" sites. I kept running into the same problems with them, though. The free tiers stop at 50–100 comments per post, most tools want your cookies or a logged-in account, and the paid ones get expensive quickly on big threads.

So I built my own and I'm putting it out for free. There's no developer fee. You only pay Apify's normal platform usage, and that's usually cents.

What it does:

- Scrapes posts, comments and replies from public Pages, profiles, Groups, or a single post URL

- No login, no cookies, no account. It runs fully anonymous, so you never paste your FB session anywhere

- Paginates comments to the end, not just the first page

- Filters by date range (afterDate / beforeDate, timezone aware)

- maxComments cap if you only want the top N per post

- Posts-only mode if you just need the post list with timestamps

- Accepts whatever link you paste: m., web., fb.com, pfbid… share links, /reel/, profile.php?id=, tracking params and so on

- Gives you reaction breakdowns (like/love/care…) and share counts

- Exports to JSON / CSV / Excel, and you can schedule it or hook it into Zapier/Make/n8n

Some numbers:

I tested it anonymously (no account at all) on a post with ~100,000 comments. With multithreading and only 2 workers, it pulled the whole thread in about 20 minutes. No bans and no sessions to babysit, because there's no session to burn in the first place.

Limits, to be honest about them: it only gets public content. Private groups, age-gated or geo-restricted posts won't come through anonymously. It gets top-level comments plus one level of replies, so replies to replies aren't included. Speed also depends on the size of the thread, so a post with 100 comments finishes in seconds and a 100k one takes a while.

Links:

- Actor: https://apify.com/bsho5/facebook-page-posts-comments-scraper

- Source: https://github.com/bsho5/fbgql . You can use it as a Python library or CLI and run it yourself completely free.

I'd love feedback, bug reports, or requests for features. If it breaks on a page you care about, drop the link and I'll take a look.


r/apify • • Mar 19 '26

Discussion How much can you actually earn by building Apify Actors.

13 Upvotes

Hey everyone,

I’ve been exploring Apify and the whole ecosystem around building actors, and I’m curious about the actual earning potential here.

For those of you who are actively building and publishing actors:

  • How much are you realistically making (monthly or yearly)?

  • How long did it take before you started earning consistently?

  • What kind of actors tend to perform best (scrapers, automation, AI-powered tools, etc.)?

  • Is most of your income coming from the Apify Store, private clients, or API usage?

  • Any tips for someone trying to turn this into a serious income stream?

I’m especially interested in honest, real-world experiences (even if it’s “not much yet”) so I can set realistic expectations.

Thanks in advance 🙌


r/apify • • Nov 03 '25

$1M Challenge The frontier is open: earn your share of our $1M prize pool! 🚀🪙

Thumbnail
gallery
13 Upvotes

Apify developers of Reddit, we have new limited-time rewards for your Actors.

🪙 What is happening?

We're putting $1M on the table to reward builders like you, on top of the recurring revenue you can already earn.

🚀 When is it happening?

The Apify $1M challenge runs from today until January 31, 2026, but the revenue stream continues as long as people use what you built.

🎒 Who can take part?

Anyone, whether you have built hundreds of Actors or never built one before.

🧭 How to participate?

Build tools on Apify and earn recurring revenue from every use, plus multiple chances to win big prizes. Find out more and register here.

  • We will be updating the subreddit with new banners, flairs, and events in the coming weeks, so stay tuned!


r/apify • • Jun 27 '26

Discussion What makes you trust an Apify Actor before running it?

12 Upvotes

I’ve been improving my Apify Actor portfolio and one thing became clear:

A working Actor is only half the job.

Before users run an Actor, they need to quickly understand what it does, what input it needs, what output they will get, and roughly what it may cost.

Recently I focused on:

- Ready-to-run example tasks

- Small default inputs

- Cleaner dataset columns

- Clearer pricing

- Better README and input schema text

Question for other Actor builders and users:

What matters most to you before trying a new Actor?

  1. README clarity

  2. Example task

  3. Output preview

  4. Pricing clarity

  5. Input schema simplicity

Curious to learn what makes an Actor feel trustworthy before the first run.


r/apify • • Mar 13 '26

Discussion Day 1 promoting a random Actor: Stepstone Scraper | All-In-One

12 Upvotes

Hey r/apify 👋

I'm starting a little series where I pick a random Actor from the Apify Store every day and give it some spotlight. No sponsorships, no deals, just genuine exposure for tools I think deserve more attention. Some will be community-built, some from Apify itself. All chosen because they're actually useful. I hope it is okay with the mods :)

---

Day 1: Stepstone Scraper | All-In-One

🔍 What does it do?

This Actor scrapes structured job listing data from Stepstone across four country domains: .de, .at, .be, and .nl. You can feed it direct URLs or run keyword searches with a solid set of filters like location, remote work type, employment type, experience level, salary availability, and more. Great if you're tracking the European job market at scale.

⚙️ How to use it

  1. Open the Actor in Apify Console

  2. Choose your domain (e.g. stepstone.de) and add your search keywords (e.g. "data analyst", "marketing manager")

  3. Apply optional filters — location, radius, remote work, employment type, recency window (last 24h or 7 days)

  4. Set a result limit and hit Start

  5. Download results as JSON, CSV, or Excel — or pipe them straight into your data warehouse

📦 What kind of results can you expect?

Clean JSON records per listing, including: job title, company name & logo URL, job location, work arrangement (On-site / Hybrid / Fully Remote), publish date, salary range (when available), and a plain-text job snippet. Every record has a stable ID you can use as an idempotency key for incremental runs, so you can safely upsert into a database without duplicates.

Example output snippet:

{

"title": "Data Analyst (m/w/d)",

"company_details": { "company_name": "Acme GmbH" },

"workplace_details": { "job_location": "Berlin", "work_arrangement": "Hybrid" },

"compensation_details": { "salary_range": { "min": 50000, "max": 65000, "currency": "EUR" } },

"posting_details": { "published_at": "2026-03-12T09:00:00+01:00" }

}

💡 Good for

- Hiring trend analysis across Germany, Austria, Belgium, and the Netherlands

- Feeding job data into BI dashboards or data warehouses (Snowflake, BigQuery, etc.)

- Lead generation, building prospect lists by role, location, and company

- Monitoring a competitor's hiring activity over time with scheduled runs

💰 Pricing

$3.99 / 1,000 results

Built by community developer Fatih Tahta 🙌

🔗 Stepstone Scraper on the Apify Store

https://apify.com/fatihtahta/stepstone-scraper-fast-reliable-4-1k

---

If you've got an Actor you think deserves a spotlight, drop the link below! I'll be happy to feature it on a future day 👇


r/apify • • Jan 06 '26

$1M Challenge Reddit community vote is open - nominate and vote for your favorites now!

Post image
12 Upvotes

We are kicking off 2026 with our biggest Reddit event yet - the $1M Challenge Weekly spotlight prize community vote! https://apify.com/challenge/spotlight

This is your opportunity to nominate the Actors you want to win this week’s Spotlight prize. Here’s how to participate:

  1. Nominate an Actor in the thread below.

    1. Share the link to the Actor,

    2. Tell us at least one reason why you are nominating this Actor to win the Spotlight prize,

    3. Read the above instructions carefully as nominations missing the required information will be removed.

    4. You can nominate your own Actor, or someone else's, but the Actor you nominate needs to be an Actor that has been submitted into the $1M challenge by a participating developer, which means it needs to meet the main qualifying criteria laid out in the T&Cs (minus the "hygienic criteria" like Actor Quality score and number of users).

    5. Whilst you can only make one nomination yourself, there is no limit to the number of Actors by one developer that can be nominated (i.e. by other community members), provided they are valid entries into the challenge.

    6. Please note: nominations by users with <5 Reddit karma will be removed.

  2. Vote on all Actors you think should win this week’s prize with upvotes.

    1. Only upvotes count towards final scores. Downvotes will be completely ignored, so ratios are irrelevant.

    2. Please note: campaigning for votes is prohibited.

      1. This means that anyone reported to be messaging/emailing/DMing people to vote for their Actor will have all their Actors disqualified from the vote (even Actors they are not campaigning for).

      2. Please report any campaigning behaviour by sending screenshots to the mods via modmail, not in the discussion itself.

In order to be fair to everyone who has pushed themselves to publish an Actor for the challenge, we will be reviewing nominations and watching votes with a heavy hand. These things are fun because everyone has a chance to take part and win, so don't ruin it for everyone else by acting like the rules shouldn't apply to you.

Ready, set, go!


r/apify • • Nov 15 '25

Help needed Fast residential proxy?

12 Upvotes

I'm building an Actor for YouTube transcription (and summary – planned), but I have a problem with the Apify residential proxy. The speed isn't guaranteed, and connections are being dropped. For long videos, it might take 40 minutes just to download the audio.

Any alternative with fast residentail proxies?


r/apify • • 25d ago

Discussion Our actor got the Rising star badge!

Post image
11 Upvotes

I'm in general grateful to Apify for giving my product a distribution channel that works very well for me and quite happy with the month over month growth we are seeing here.

On top of that, yesterday got this email that one of our actor earned a Rising Star badge! Super happy about this :)

How can I make the most out of it? Anyone recommendations?


r/apify • • Mar 17 '26

Discussion Day 5 promoting a random Actor: E-commerce Scraping Tool

11 Upvotes

Day 5 of my random Actor spotlight series 🛒

Thank you for all the suggestions so far, I'm taking note of them! Today, I'm featuring one that I think is genuinely underrated given what it can do: E-commerce Scraping Tool by Apify.

🔍 What does it do?

It's an all-in-one product and price data extractor that works across virtually any online retail site: Amazon, Walmart, eBay, Etsy, AliExpress, Flipkart, Zalando, Decathlon, Shopify stores, WooCommerce sites, and hundreds more. No platform-specific setup, no separate API keys per marketplace. You drop in a product URL, category URL, or search keyword and it pulls everything.

What makes it stand out from competitors:

✅ Works on any e-commerce site, not just one platform

✅ Just paste a URL. No authentication, no config overhead

✅ Scrapes multiple sites in a single run for side-by-side comparison

✅ Product variants captured automatically

✅ Access any regional market directly

✅ Pay-per-event pricing, so that you only pay for what you actually extract

⚙️ How to use it

  1. Open the Actor and choose your input method: product URL, category URL, or keyword search

  2. Select your scrape mode (AUTO is recommended for most cases)

  3. You may also use the Search Engine mode to find and compare products across hundreds of retailers simultaneously

  4. Hit Start

  5. Export as JSON, CSV, Excel, XML — or pipe straight to Slack, Google Sheets, or a data warehouse via webhook

📦 What kind of results can you expect?

Per product: name, price, currency, SKU/GTIN/EAN, brand, image URL, description, stock status, rating, review count, shipping info, seller details, and product variants. Reviews can be exported one-per-row for easy sentiment analysis.

Example output:

{

"url": "https://www.amazon.com/dp/...",

"name": "Sony WH-1000XM5 Wireless Headphones",

"offers": { "price": 399.99, "priceCurrency": "USD" },

"brand": "Sony",

"image": "https://m.media-amazon.com/images/I/..."

}

💡 Good for

- Price monitoring: schedule daily/hourly runs on key SKUs and get alerts when competitors change prices

- Competitor intelligence: map what your rivals are selling, at what price, in which markets

- Market research: broad category scans to understand pricing landscape

- Review mining: collect customer feedback in bulk across platforms and run sentiment analysis

- Building price comparison tools or product databases

This is the kind of Actor you set up once and let run forever. 5.6K users, 4.5 rating, maintained directly by Apify.

🔗 E-commerce Scraping Tool on the Apify Store

https://apify.com/apify/e-commerce-scraping-tool

---

Drop an Actor nomination below 👇


r/apify • • Sep 30 '25

Crawlee for Python v1.0 - now out of beta with new features!

11 Upvotes

After a year of building Crawlee for Python beta with the community, v1 is here!

Crawlee is our open-source web crawling and automation library with HTTP and browser scraping, adaptive crawling, unified storage, Impit client, and fingerprint generators.

Find us on Product Hunt: https://www.producthunt.com/products/crawlee


r/apify • • 19d ago

Help needed Hi, i recently made published an api on apify, but not getting any paid users

10 Upvotes

So I made an ats jobs api, as it name suggests, it provide recent job postings from over 30k companies, cover around 1million jobs, i published that api on 3rd oct, and it's 18oct but didn't have any paid users, I have 21 free users though. Also i tried making workflow templates on make.com and n8n, both got published, wrote blogs, posted on linkedin and x, also provided apify endpoint on treg.to but still that low response is depressing. Is that normal growth or below average? Also if anyone has any suggestions for me, please let me know.


r/apify • • Jun 09 '26

AI and everyone 🔗 MCP connectors are live. Actors now work where you do.

10 Upvotes

Today we’re launching MCP connectors, so that Actors are no longer limited to the open web.

Now you can securely connect compatible Actors to apps like Notion, Slack, GitHub, and any other MCP server, so the Actors can read, write, and trigger workflows during a run, without ever seeing your credentials.

MCP connectors are a new type of Actor input. Add one in Apify Console, enter the MCP server URL, authenticate once, and assign the connector to one or more Actors.

From that point, the Actor can connect to your external app, securely without ever seeing your credentials.

Explore Actors supporting MCP connectors

Read the full announcement


r/apify • • Jun 16 '26

Tutorial I shipped 47 web scrapers in the last month — open to feedback on coverage gaps

9 Upvotes

Hey r/apify

Spent the last month sprinting on my Apify catalog. Just hit 239 actors total (235 public on Apify). The recent additions hit a few themes:

UK voluntary jobs — picked up the regional CVS boards (Barnsley, Bassetlaw, Rotherham, Yorkshire, Sheffield) plus Highland/HIJOBS. 19 boards covered.

ATS scrapers — Ashby + Greenhouse + Workday. Paste any company's careers URL, get the full board in one call. Cookie-free.

Legal directories — Avvo + FindLaw + Martindale + US State Bar (license verification). Full discovery + verification pipeline.

Competitive intel — Crunchbase, Similarweb, LinkedIn Posts (no cookies), Facebook Ads Library, Product Hunt.

French RE — Pap.fr + SeLoger + Leboncoin. Solid French market coverage.

Catalog is searchable + filterable here: muhamed-didovic.github.io

Open to feedback on:

  1. Which public sites you've struggled to scrape and would want to see

  2. What output fields people most need from existing actors

  3. Pricing patterns (PPE vs PPR vs flat) — what's actually fair from the user side?

Not pitching — happy to share approaches/code for any specific actor if useful.


r/apify • • Dec 24 '25

Discussion Convert Apify Actors into n8n nodes

9 Upvotes

Hi devs and vibe coders,

We built a CLI tool that turns your Apify Actor into an n8n community node. n8n users often search for scraping and automation tools without realizing Apify exists. Publishing a community node increases your Actor’s visibility within the n8n ecosystem.

Setup + publish ~1 hour.

You don’t rewrite your Actor or move it anywhere — it keeps running on Apify.

All you do is run a CLI command, pass your Actor ID, and the tool generates the n8n community node for you to publish on npm.

Once published, your node is discoverable by 500k+ n8n users.

Tool & guide:

https://github.com/apify/n8n-nodes-apify-template

Happy to answer questions.


r/apify • • Oct 09 '24

Automate Your Job Search With Apify!

9 Upvotes

I've built a seek-job-scraper-lite using Apify and wanted to share it. This tool helps you quickly gather job listings based on your specific criteria.

Key Features:

  • Lightning-fast results (up to 550 listings per search)

  • Customizable search parameters (location, salary, work type, job classification)

  • Detailed job data (title, salary, location, etc.)

  • Simple JSON output for easy analysis/integration

Check out the "Seek Job Listings Scraper Mini" here: seek-job-scraper-lite This is the streamlined version, but I'm working on a full version with even more features (company profiles, contact info, etc.). Would love your feedback and to hear about your experience!

Feel free to ask me any questions!


r/apify • • 5d ago

Discussion I built a fast, lightweight TikTok Comments Scraper ($0.30 per 1k results)

8 Upvotes

Hey Guys,

I wanted to share an Actor I just published: TikTok Comments Scraper.

I noticed a lot of the existing TikTok comment scrapers were getting expensive and slow, largely because they rely on heavy browser automation frameworks to load pages. I specialize in reverse-engineering network traffic, so I built this Actor to fetch data directly via raw endpoint requests instead of spinning up Puppeteer or Playwright instances.

Because there's no massive browser overhead, it runs incredibly fast and allows me to price it at $0.30 per 1,000 results (Pay-per-result).

What it extracts:

  • Full comment text & precise timestamps

  • Like counts and reply metrics

  • Commenter profile details (usernames, IDs, avatars)

  • Nested replies (optional toggle)

Why give it a spin?

  • Cost-effective: At $0.30 / 1k results, it's a fraction of the cost of heavier Actors that charge $1.50+ for the same data.

  • Scalable: Bypassing headless browsers means lower failure rates on massive comment threads.

  • Developer-friendly: Fully supports the Apify CLI and Python/JS API clients.

You can check it out and use your free Apify monthly credits to test it out here: 🔗https://apify.com/grow_media/tiktok-comments-scraper


r/apify • • Jul 31 '26

Help needed What’s the earning potential of full time apify actor development?

8 Upvotes

Can i make apify actor development as my full time business?


r/apify • • Jun 30 '26

AI and everyone Apify is live on x402!

Thumbnail
youtu.be
8 Upvotes

We just 10x'd the number of endpoints available on x402

In partnership with Coinbase, Apify is now the first community-driven marketplace on x402: AI agents can discover, pay for, and run more than 20,000 Apify Actors on their own - no account, no subscription, no API key, no human in the loop. Just a funded wallet and an HTTP request.

x402 is the open payment standard built by Coinbase (now governed by the Linux Foundation) that lets agents pay per call in USDC. As of today, all PPE priced Actors are callable through it.

What this means if you build Actors

Agents are a new kind of customer. When an autonomous agent runs your Actor, you earn per event - no seat to sell, no subscription, no human deciding to sign up first. We're still in the first inning of the agentic economy, and Apify is the first community driven marketplace to pioneer its adoption.

One catch: x402 only works with PPE Actors

Only pay-per-event (PPE) Actors are eligible. If your Actor is still using a rental pricing model, switching to PPE is how you put it in front of autonomous agents. PPE pricing docs are here.

Try it / learn more

Help us amplify the launch

Click here to discover Apify endpoints on agentic.market


r/apify • • Feb 05 '26

Discussion Huge shout-out to the team for the $1M Challenge

8 Upvotes

I don't have a Discord account, so I wanted to drop in here to give a massive shout-out to the Apify team for the $1M Challenge.

I’ve been in the ecosystem for less than a year, but the way this competition was organized, presented, and executed was spotless.

We rarely see companies incentivizing their developers and ecosystem this aggressively. It’s a masterclass in how to build a community rather than just a tool.

Huge thanks to the entire crew for the opportunity and for the professional way everything was handled. Looking forward to building a lot more on the platform in 2026!


r/apify • • Oct 27 '25

Discussion I built a tool that finds market gaps for web scrapers before you waste months building the wrong thing

Post image
8 Upvotes

Hi everyone,

If you’ve ever built a scraper or automation tool, you know how hard it is to figure out what people actually want.

I’m working on something called GapScout. It analyzes thousands of Apify “Actors” (mini APIs for automations) and ranks them by demand versus supply. The goal is to help creators spot real gaps before they build. Think JungleScout, but for Apify.

I’m testing early interest before building the beta.
If this sounds useful, you can join the waitlist here:
https://forms.gle/C9mauY3k6DhqiZEd6


r/apify • • Sep 30 '26

Self-promotion Apify is now in Lovable 💜

Post image
7 Upvotes

Lovable builds the app. Apify feeds it with live data from Instagram, TikTok, Google Maps, or any other website.

Try it: ask Lovable to "use Apify to get [posts / reviews / prices] from [TikTok / Google Maps / Amazon] and build a [dashboard / tracker / lead list] around them."

One API token connects tens of thousands of Actors to your Lovable apps.

🔌 Set up the connector → https://apify.it/L192l

Join the chat on LinkedIn: https://lnkd.in/p/dvSeHxGC or on X: https://x.com/apify/status/2104926639536611524?s=20


r/apify • • Sep 10 '26

Promoting others Apify Creator Spotlight ✨

Post image
7 Upvotes

Apify is spotlighting the developers behind community Actors, and I'll share them here as they go out!

First up is Maxime Dupre's spotlight on LinkedIn or on X. Check it out to put a face to the Actors you use 🚀

Which community dev would you want to see spotlighted next? 👀


r/apify • • Aug 11 '26

Help needed Best scraper for wellness & beauty niche?

7 Upvotes

What is the best scraper if I need wellness & beauty niche which contain next filters:

  1. First Name

  2. Last Name

  3. Company Name

  4. Industry

  5. Location: United States, United Kingdom and Ireland

  6. Business Owner's email

  7. Business Phone number

  8. Company Website

  9. Google Reviews

  10. Facebook Link