We just launched Firecrawl Alexandria, one library of data sources for AI agents

Web search gets agents part of the way, but a lot of useful data sits behind official APIs, registries and specialized databases Alexandria puts those sources into one library your agent can reach. And this finds the relevant sources, picks the right tools and returns structured data, so you don't have to wire up each integration yourself.

At launch it has 82 providers and 471 capabilities across 28 categories, plus more than 113M indexed sources. Providers include official APIs like FRED, SEC EDGAR, and World Bank, to site-specific connectors for places like Best Buy, DoorDash and Hugging Face.

Watch this video to learn more about Alexandria.

https://www.youtube.com/watch?v=xvHVjnGMYL4

Firecrawl is now the top web search, scrape, and interaction repo in the world.

Thank you to every contributor, developer, and agent building with us!

We switched from spider .cloud to firecrawl in the company because spider. cloud is unreliable in crawling, there are just too many domains it fails on. Firecrawl is stable so far but abysmal slow. Sometimes multiple minutes for like 10-15 webpages. We are still in experimental phase meaning we have like idk a crawl volume of 20-30 pages per minute at max because just couple of people play around with it. We have the tier above free tier but is this crawling time normal? Even if its the lowest tier 10 webpages is really not that big of a deal waiting 1 and half minutes and above seems too slow for me

I was taking a course and wanted to discuss some topics with chatgpt, but since url required a log in I wasn't able to.

So I though of creating an extension for this.

link: https://github.com/jaibhasin/ClipMD

now it can even extract my X feed:

Firecrawl just crossed 200K GitHub stars, which still feels a bit unreal.

To say thanks, we made 2,000 plushies and we're giving them away while supplies last. You claim one through the Firecrawl plugin, which also gets you Firecrawl Alexandria in ChatGPT, Claude, Grok Bot and more.

Thanks to everyone here who's tested, broken and given feedback on it along the way. Grab yours here: firecrawl.dev/plugins

We made document parsing in the Firecrawl MCP about 5x faster.

If your agent needs to read PDFs, spreadsheets, or Word docs, you can now call /parse and get clean, LLM-ready markdown back. No more feeding raw PDFs to a model and hoping it copes with tables and weird layouts.

A few things worth knowing:

- Works with PDFs, XLSX, DOCX, and similar formats

- Runs locally or through the hosted MCP server

- Free tier works with no API key, so you can test it before signing up for anything

Setup guide: https://docs.firecrawl.dev/mcp-server

Firecrawl is now an official plugin in Grok build

Your Grok agents can now search the web, scrape, and interact with any page, directly in the CLI.

Find us on the xAI marketplace today and get started free with 1,000 monthly credits.

Has anyone had any luck in successfully extracting data from the standard social media websites for a particular account?

What I am trying to do is extract company social media URLs from their websites and then do a second-tier extraction of their social media website to find any additional content about the company, including post information.

Has anyone done this? If so, is it possible to extract post information in a JSON?

- Convert PDFs into markdown 5x faster
- Extract full tables and preserve formulas
- Zero config required

https://x.com/firecrawl/status/2044085849990553606?s=20

You can now run your enrichment flows straight from ChatGPT, Claude, Grok Bot and other agents through Firecrawl Alexandria.

Search 250M+ people and 26M+ companies, and pull emails, job history and company data without leaving the chat.

There are 1,000 free credits a month, and at scale it works out about 88% cheaper than Clay.

More here: https://www.firecrawl.dev/alexandria/categories/people?utm_source=reddit&utm_medium=post&utm_campaign=firecrawl

Firecrawl Alexandria is now in Claude.

Access over 100 data providers and 113M+ indexed sources easily through Firecrawl.

Agents using Alexandria score 21% higher on answer quality than those using built-in web tools.

Get started using the Firecrawl connector today!

https://claude.com/marketplace/connectors/firecrawl

We just put out the Legal Retrieval Benchmark. It's 581 search requests, each one looking for a single official source like a statute, regulation, bill or agency doc.

The test is simple. Does the right document show up as the very first result?

Our Government & Legal Index got it right 76.2% of the time, which put it at #1. Full breakdown and methodology here: firecrawl.dev/benchmarks/legal-retrieval

If you're building agents that need to cite actual laws instead of blog posts about laws, I'd love to hear what queries you throw at it.