Back to Gap Map Product / UX / Search & retrieval

Apify

Apify
source available / Overall score: 3.4

Apify is a web scraping and automation platform with a marketplace of tens of thousands of pre-built scrapers, called Actors, that target specific websites. It provides cloud infrastructure for running them at scale, proxy management and anti-bot handling, plus an MCP server that exposes Actors to agent clients. Crawlee, Apify's open-source crawling framework, is offered alongside the managed platform.

Openness

2 high confidence
2.0
platform
proprietary(Apify-Cloud,Actor-store,managed)
source
partial(Crawlee SDK published, the platform that runs Actors is not)
oss-sdk
Crawlee(Apache-2.0,OSI, JS+Python)
license
mixed(platform closed, SDK open)

Apify's platform and Actor store are proprietary hosted services, and the runtime that executes Actors is not published. Crawlee, its Apache-2.0 scraping library, has a public repository, but it is an adjacent library rather than the platform core, so the disclosure is partial rather than an open core with a few paid features withheld.

Adoption

3 medium confidence
3.0

Named enterprise users such as T-Mobile, Microsoft and Accenture run on the Apify platform, and the open-source Crawlee library draws heavy attention on GitHub. Apify publishes no account, run or API-call count for the platform itself, so adoption here is a judgment made across the platform and Crawlee together rather than one measured figure.

  • https://apify.com recorded 2026-08-13

    "Browse 59,817 Actors" in the store; T-Mobile and Accenture among named enterprise users; a Discord invite link. NOT on the page: a Discord member count, an account count, a run count or an API-call figure.

  • https://github.com/apify/crawlee recorded 2026-08-13

    25,373 stargazers on the OSS Crawlee library. Corroborating attention signal, not the basis.

Capability

4 high confidence
4.0

Apify's own first-party actors, such as Google Search Results Scraper, call the platform API directly and return organic search results and dataset items, putting search and retrieval on the platform itself rather than only in its marketplace -- third-party actors that the store merely hosts, built by other developers, do not count toward this. That puts Apify level with Firecrawl.

  • https://apify.com/apify/google-search-scraper recorded 2026-09-17

    Google Search Results Scraper, `apify/google-search-scraper`: "Developer Apify. Maintained by Apify", "Scrape Google Search Engine Results Pages (SERPs)... extract organic and paid results, AI Mode, AI overviews, ads, queries, People Also Ask", priced from $1.80 per 1,000 scraped search result pages, 17K monthly active users. Establishes a first-party query-driven search surface rather than a hosted third-party one.

  • https://docs.apify.com/api/v2 recorded 2026-09-17

    The Apify API v2 reference: Run Actor, "Run Actor synchronously and get dataset items", Get list of runs, and the dataset endpoints. Establishes that the documented interface runs an actor and returns its structured output.

Verified 2026-09-17, except some scores, still awaiting re-confirmation