Product / UX / Agent tools & protocols

Apify

Full-stack web scraping and automation platform with a marketplace of 2000+ pre-built scrapers (Actors) for specific websites. Provides cloud infrastructure for running scrapers at scale, proxy management, and anti-bot handling. The most mature commercial web scraping platform now repositioned for AI agent workflows. Offers both a managed platform and Crawlee, their open source crawling framework (23K stars).

Apify full-stack web scraping/extraction platform, verified live June 2026. Proprietary SaaS (35,000+ Actors store) with open source Crawlee library (Apache-2.0) as its scraping SDK. Sub-segment: browser/scrape infra for agents.

Openness

2 high confidence

2.0

platform: proprietary(Apify-Cloud,Actor-store,managed)
source: partial(Crawlee SDK published, the platform that runs Actors is not)
oss-sdk: Crawlee(Apache-2.0,OSI, JS+Python)
license: mixed(platform closed, SDK open)

The product proper (Apify platform/Actor store) is proprietary SaaS; Apify also maintains the OSS Crawlee scraping library (Apache-2.0). Crawlee is an adjacent SDK rather than the platform core, so most value stays behind the managed cloud. Class corrected from open_core on 2026-07-30. In this ladder open_core means an OSI core with functionality withheld for a paid tier, and there is no open core here, only an open periphery. A repo that exists while the runtime does not ship is source:partial, which the ladder scores 2/source_available. The score itself was already 2.

https://apify.com recorded 2026-06-04
proprietary full-stack scraping platform with 35,000+ Actors; Crawlee called out as their OSS contribution
https://github.com/apify/crawlee recorded 2026-06-04
Crawlee Apache-2.0 license (OSI), Apify's open source scraping library

Adoption

3 medium confidence

3.0

Crawlee at 23.7k GitHub stars (corroborating, not basis); platform serves named enterprises (T-Mobile, Microsoft, Accenture) and a 15,000+ member Discord. 35,000+ published Actors implies a sizable active developer base. No precise account/API-call count published; placed at 3 on combined developer/usage signal across platform + OSS SDK.

https://apify.com recorded 2026-06-04
35,000+ Actors, named enterprise users (T-Mobile, Microsoft, Accenture), 15,000+ Discord members
https://github.com/apify/crawlee recorded 2026-06-04
23.7k stars on the OSS Crawlee library (corroborating signal)

Capability

4 high confidence

4.0

Broad scrape/browse feature matrix, multi-engine crawling, proxy/anti-block, structured extraction, serverless deploy, and MCP integration for agents. Among the most complete scrape platforms; rated 4 (frontier-adjacent for the browser/scrape sub-segment).

https://apify.com recorded 2026-06-04
multi-engine crawling, proxy rotation, Actor store, MCP-client integration
https://github.com/apify/crawlee recorded 2026-06-04
Crawlee multi-engine (Playwright/Puppeteer/Cheerio/JSDOM), proxy + session management

Unchanged since 2026-07-30 (last edited, not re-checked)