WEB DATA FOR AI AGENTS
Give your agent
the whole web.
Scrape a page or crawl an entire site through our proxy network. Get clean, LLM-ready Markdown in seconds.
✓ Proxy-native✓ Markdown output✓ Usage metering
Ready
_Your extracted Markdown will appear here.
AGENT INTERFACE
One command.
Any website.
Install the zero-dependency CLI on any machine with Node.js 22+. It emits structured JSON by default and clean Markdown on demand.
$ curl -fsSL https://hypercrawl.syfo.io/install.sh | sh $ export HYPERCRAWL_API_KEY="hc-..."$ hypercrawl scrape https://example.com --markdown $ hypercrawl crawl https://docs.example.com --limit 50
CONTROL PLANE
API keys & usage
Agent access keys
Keys are shown once. Store them in your agent's secret manager.
Scrape
Turn one URL into clean Markdown, metadata, and discovered links.
Crawl
Traverse a site with configurable page limits and depth controls.
Measure
See requests and collected pages for every agent access key.