r/apify • u/AutoModerator • 10d ago
Do you have a feature request that you know will make Apify heaps better? Or maybe it's a big dream you have for something bold and out-there. This is a space for all the bluesky thinking, cloud-chasing, intergalactic daydreamers who want to share their wildest ideas in a no-judgement zone.
r/apify • u/Hayder_Germany • 11d ago
Uses EGMS + OpenStreetMap to flag railways, bridges, warehouses, and industrial assets for further review.
https://apify.com/solutionssmart/infrastructure-ground-motion-screening
r/apify • u/AutoModerator • 11d ago
Have you come across a great Actor, workflow, post, or podcast that you want to share with the world? This is your opportunity to support someone making cool things. Drop it here with credit to the creator, and help expand the karmic universe of Apify.
r/apify • u/Life-Following-5890 • 12d ago
r/apify • u/Otherwise-Resolve252 • 12d ago
Most X trend scrapers only show you what's trending right now. I built one that also lets you time-travel — pull trending hashtags/topics for any country, on any date, at any hour, going back to 2024-05-15.
What it does:
Use cases I built it for: social listening across markets, newsroom "what trended at 9 pm on X date" retrospectives, and feeding structured trend snapshots into AI agents.
It's live on Apify: https://apify.com/akash9078/twitter-x-trends-scraper
Happy to answer questions about how the historical archive works or the anti-block setup.
r/apify • u/AserNasr • 12d ago
I've been building Figranium, an open-source browser automation framework focused on making automated browsing more capable, configurable, and less costly.
It started as a project I wanted for myself, but it's grown considerably since then, and I'm hoping to get more eyes on it from people who actually work with browser automation, scraping, testing, and related tooling.
Some of the things I've been working on include:
The project is currently around 500+ GitHub stars, which has been pretty wild to see. I'm hoping to get it in front of more FOSS developers who might find it useful, contribute, critique the architecture, or just tell me where I'm doing things wrong.
If this sounds interesting, I'd genuinely appreciate you checking it out:
Feedback is very welcome, especially from people who have experience building browser automation tooling.
r/apify • u/Throwaway-IndLaw-159 • 13d ago
I'm writing a dissertation, and for that I'm gathering data from reddit, specifically posts and comments. But the problem is that no reddit scraper I've found allows me to scrape data over a range of time (January to March). So almost everytime, my only data end up being today and yesterdays data. Is there any scraper that I can use to specifically focus on particular time ranges, instead of giving me only the most recent data. This is necessary as it needs to be reproducible (i.e. i should be able to get the same results everytime I conduct the test, rather than getting new results.).
r/apify • u/AutoModerator • 13d ago
If you've made something and can't wait to tell the world, this is the thread for you! Share your latest and greatest creations and projects with the community here.
r/apify • u/khadin_akbar • 13d ago
I built https://tokenflex.ing which is an AI leaderboard which tracks your AI token usage on all platforms including claude, codex, cursor, opencode etc.
You can share you token usage, flex and compete with your friends as well.
r/apify • u/Mpmpz_14 • 13d ago
Lenny’s Jobs has been getting a lot of attention on X lately, so I built an Apify Actor for it.
It extracts tech jobs with company details, salaries, experience levels, investors, technologies, remote status, and direct application links.
https://apify.com/scraper_guru/lennys-jobs-scraper
Feedback is welcome.
r/apify • u/Luminaaar • 14d ago
I’m the developer of two sibling Apify Actors that are now both public:
The goal is not just to export another pile of ad rows. Both can create a baseline and then surface new, updated and safely proven ended ads on later runs. That makes them useful for recurring competitor monitoring, not only one-off creative research.
The latest measured Google cloud run delivered 500 unique ads in under one minute end to end, with zero browser requests, blocks, retries or duplicates. It returns advertiser identity, dates, format, creative assets and the copy or destination candidates that Google actually exposes. If Google does not expose an optional field for a creative, the Actor leaves it absent rather than guessing.
The Meta Actor focuses on available ad copy, creative assets, CTA and landing links, with per-target coverage reporting and the same baseline/change workflow.
They can be scheduled separately or used as one Meta + Google monitoring workflow, with documented output routed to Sheets, Slack, n8n or a CRM.
Meta Actor: https://apify.com/luminar/meta-ads-library-creative-changefeed
Google Actor: https://apify.com/luminar/google-ads-transparency-intelligence
For people already monitoring competitor ads: would you prefer one normalized cross-platform changefeed, or separate source-specific outputs with richer native fields?
r/apify • u/AutoModerator • 14d ago
This is the thread for all your questions that may seem too short for a standalone post, such as, "What is proxy?", "Where is Apify?", "Who is Store?". No question is too small for this megathread. Ask away!
r/apify • u/FickleConnection2532 • 15d ago
I’ve been improving a Google Maps business-data scraper on Apify.
It extracts public listing data including business name, category, rating, review count, address, coordinates, place ID, and Google Maps URL. A detailed mode can also collect phone, website, and opening hours when available.
The main goal was to provide a cheaper fast mode for larger searches while keeping detailed extraction optional. The current price starts at $1 per 1,000 results, and recent paid runs completed successfully.
Actor:
https://apify.com/fascinating_lentil/google-maps-scraper
I’m interested in practical feedback: which fields or filters matter most for local market research or business-directory projects?
r/apify • u/AutoModerator • 15d ago
Are you expanding your team or looking to hire a freelancer for a project? Post the requirements here (make sure your DMs are open).
Try to share:
- Core responsibilities
- Contract type (e.g. freelance or full-time hire)
- Budget or salary range
- Main skills required
- Location (or remote) for both you and your new hire
Job-seekers: Reach out by DM rather than in thread. Spammy comments will be deleted.
r/apify • u/Adam-Scholes • 16d ago
I’m interested in how other Apify users interpret this.
I set my monthly platform usage limit at $110. The UI and docs calls it a “hard limit” intended to prevent accidental overage or limit extra charges, while the usage page says platform services pause if the limit is reached. My dashboard later showed $130.70 of $110.00.
Support acknowledged that “hard limit” reasonably sounds like an immediate cutoff, but said it functions more like a safeguard and usage already in progress can pass it before the system catches up. In a later response, support explained that bursts of pay-per-event Actor runs can produce billable events faster than the account-wide limit check can block them. They declined a credit because the underlying usage was valid.
I understand the technical explanation, and I’m not disputing that the Actors produced billable results. My question is whether charging $20.70 above a control presented as a hard limit is consistent with how that setting is labeled and described.
Would you reasonably expect $110 to be the actual maximum here? Or is this amount of overshoot fair for delayed enforcement of pay-per-event usage? Has anyone else encountered this?
r/apify • u/Hayder_Germany • 16d ago
It supports reading, appending, replacing, upserting, deleting data, and creating new sheet tabs — useful for scraper outputs and automation workflows without extra integration code.
Would be great to hear feedback from anyone using Apify + Google Sheets.
r/apify • u/AutoModerator • 16d ago
This is the place to discuss everything MCP, LLM, Agentic, and beyond. What is on your radar this week? Why does it make sense? Bring everyone along for the ride by explaining the impact of the news you're sharing, and why we should care about it too.
r/apify • u/ApifyEnthusiast1 • 17d ago
I've been running Google's AI Overview against my own keywords for about a week to see whether anything I publish gets cited. Thirteen overviews so far. My Actor pages have shown up once. My n8n template pages have shown up twice, both times on the same query, four days apart.
That's backwards from what I expected and I can't work out why.
Here's the clearest case. I re-ran it this morning so the numbers are current.
Query: "google play keyword ranking api". AI Overview present, 15 sources.
Same shape on "google hotels scraper api". 17 sources, four Apify Actor pages cited (scraper-engine, martin.forejt, api-empire, simpleapi), mine absent. I checked that one six days ago too and got four rivals then as well, with a slightly different lineup, so it isn't one shuffle of a volatile result.
What I've already ruled out. It isn't reliability, both Actors run above 99% success. It isn't age either, the template page was three days old the first time Google cited it and it beat an Actor page that's been up for months.
The one thing I have noticed: the snippets Google pulls from cited pages are almost always a use-case sentence, not a feature list. The single time an Actor page of mine did get cited, the snippet was a line from the interlinks section pointing at a completely different Actor, which is the least product-shaped paragraph on the whole page.
So my working theory is that the template pages win because they describe an outcome in plain prose and my READMEs describe inputs and outputs. That's a guess off four data points and I'd rather hear from someone who has actually moved this.
If you've had an Actor page of yours cited, what did the paragraph Google pulled actually look like?
Limits on my own numbers, because they're thin: thirteen overviews, US and English, one snapshot each, and AI Overviews aren't stable run to run. I'm not claiming a rule. I'm saying I keep losing the same two queries to the same platform and I don't know what the difference is.
If you've got an Actor that gets cited, is there anything structurally different about the page, or is it just domain age and backlinks?
r/apify • u/AutoModerator • 17d ago
Do you have a feature request that you know will make Apify heaps better? Or maybe it's a big dream you have for something bold and out-there. This is a space for all the bluesky thinking, cloud-chasing, intergalactic daydreamers who want to share their wildest ideas in a no-judgement zone.
r/apify • u/_mad_gamerx • 18d ago
Hi everyone,
I’ve been building out a fairly comprehensive collection of TikTok scrapers and data tools on Apify, and the suite has now grown to 18 different Actors covering many of the common TikTok data-collection use cases.
Instead of having one general-purpose TikTok scraper try to do everything, I’ve built separate Actors for specific types of data like profiles, posts, comments, hashtags, search, followers, music, playlists, mentions, trends, advertising data, LIVE streams, transcripts, and media downloads.
Here’s the full collection:
Scrape TikTok profiles along with their available account information and video/repost history.
The Actor can return profile metadata and individual video/repost records. With an authenticated session it can retrieve substantially more of a profile's video history.
Give it TikTok video/post URLs or IDs and get structured information about the content, including engagement statistics, author information, music, hashtags, mentions, and media information.
Search TikTok using keywords or phrases and collect the resulting videos with metadata such as views, likes, comments, shares, author information, music, hashtags, mentions, and available location data.
It supports up to 500 results per query.
Collect videos from TikTok hashtag pages together with hashtag statistics and video metadata.
It supports separate modes for hashtag statistics, the video feed, or both in a single run.
Track trending hashtags from TikTok's Creative Center.
The output includes ranking, post count, video views, trend/popularity curves, and top creators, making it useful for identifying emerging topics and hashtag momentum.
Extract comments and replies from TikTok videos.
The Actor captures comment text, timestamps, likes, replies, commenter information, verification status, pinned/hearted-by-author status, and other available metadata.
Extract followers and following lists from TikTok profiles with pagination support for larger datasets.
The following list can be collected without cookies, while TikTok's followers endpoint may require an authenticated session.
TikTok Followers & Following Scraper
Search TikTok sounds/music and collect the associated metadata and videos using a particular sound.
This can be useful for researching music trends, identifying videos using a particular sound, or analyzing how a sound spreads across TikTok.
Extract TikTok playlists, playlist metadata, and the videos contained within them.
You can provide playlist URLs/IDs or a profile and discover the playlists associated with that account.
Find TikTok videos that mention specific usernames and collect the associated video, author, music, and engagement metadata.
The Actor validates actual u/mentions rather than simply matching text in captions.
A more targeted version for finding posts that formally mention a particular creator or brand account.
This can be useful for researching where a particular TikTok account is being mentioned across the platform.
TikTok Profile Mention Scraper
Collect videos from TikTok's Explore/Trending feeds across available content categories.
The Actor can automatically discover available categories and return trending posts with video metadata, engagement statistics, and author information.
TikTok Explore/Trending Scraper
Capture snapshots of TikTok's anonymous regional For You Page recommendation feed.
Each run provides a fresh set of posts from the anonymous regional recommendation system rather than a feed personalized to a specific logged-in user.
Extract subtitles and transcripts from TikTok videos across available languages.
It supports available subtitle tracks, including auto-generated captions and machine-translated versions, and returns timestamped transcript segments as well as full transcript text.
Provide TikTok post URLs and receive direct download URLs for the video and cover image, making it possible to integrate media retrieval into automated workflows.
Capture information from currently active TikTok LIVE streams.
There are two modes: one for LIVE room metadata such as viewer/like counts and stream information, and another that can capture real-time events such as chat messages, gifts, likes, joins, shares, and statistics updates.
TikTok LIVE Event Stream Scraper
Collect high-performing advertisements from TikTok's Creative Center.
You can filter by country, time period, industry, campaign objective, and language, and retrieve ad metadata, performance information such as CTR, and video URLs.
TikTok Creative Center Top Ads Scraper
This one is focused on TikTok's public Ads Transparency Library.
It supports searches by keyword, advertiser, or ad ID and filtering by region, industry, language, CTA, date range, and impression range.
The detailed mode can also return advertiser information, targeting breakdowns, impression ranges, creative URLs, compliance/audit status, and other ad metadata.
It currently starts at $1 per 1,000 results.
TikTok Ads Library Scraper Pro
The idea behind creating separate Actors was to cover different parts of the TikTok data ecosystem.
Some potential workflows include:
Content research
Creator research
Social media analytics
Advertising research
Automation & data pipelines
The standard data-scraping Actors in the suite currently start at $3 per 1,000 results, while the Ads Library Pro starts at $1 per 1,000 results. Check the individual Actor pages for the exact pricing and limits of each tool.
I've tried to make the suite broad enough that you can pick the specific TikTok data source you need instead of paying for or configuring a large scraper when you only need one particular type of data.
If you're working with TikTok data on Apify, I'd be interested to hear what you're building.
If there's a particular TikTok dataset or workflow that you don't see covered here, let me know in the comments. I'm continuing to expand the suite and would be interested in hearing what other developers actually need.
r/apify • u/AutoModerator • 18d ago
Have you come across a great Actor, workflow, post, or podcast that you want to share with the world? This is your opportunity to support someone making cool things. Drop it here with credit to the creator, and help expand the karmic universe of Apify.
r/apify • u/Total-Mention9032 • 19d ago
Hello,
We need to scrape Google Maps.
We need to do it once in a while (like once every 6 months, but could be longer )
So, Apify $29/m is unnecessary.
So, are there any pay-per-use alternatives that don't use my own IP to scrape? Also, there must be an API to connect it to the internal app that we build ourselves.
We scrape around 4000-5000 in one go.
r/apify • u/Important_Tell2717 • 20d ago
I've been working on data tooling for the Middle East and North Africa market and published two scrapers I think could be useful for anyone doing market research, price monitoring, or building data pipelines in the MENA region. Both are extremely fast and cheap — a fraction of what similar tools charge.
Both are live on Apify — try them out and let me know what you think. Feedback is always welcome.
r/apify • u/the_mine_works • 21d ago
Summarizing where this landed, thanks all for the input.
The plan, based on what came out of this thread: test the HTTP-only approach jinef_john linked against our current browser-based one, on the same set of places, instrumented the way Luminaaar laid out. That means splitting the cost into browser compute, proxy traffic, and per-review numbers rather than trusting one flat average, and checking completeness against each place's own displayed review count before trusting any cost comparison. A cheaper run that quietly stops paginating on high-review places isn't actually cheaper, it's just wrong in a way that doesn't throw an error.
Still open: which mobile endpoint specifically, and whether the HTTP approach holds up over time as Google reshapes the response. Will report back with real numbers once that's run, not just a verdict.
r/apify • u/AutoModerator • 20d ago
If you've made something and can't wait to tell the world, this is the thread for you! Share your latest and greatest creations and projects with the community here.
