Documentation

Every endpoint, every parameter, real responses pulled from the live API.

Getting started

POST
/v1/scrape
Quickstart
Get your first response in under five minutes.
GET
/v1/me
Authentication
Every call needs an Authorization header with your API key.
GET
/v1/me
Rate limits and quotas
Per-minute rate limits and per-month quotas — both enforced.
GET
/v1/*
Errors and retry strategy
Predictable error codes and a recommended retry pattern.

Scraping

POST
/v1/scrape
Scrape a single URL
Fetch one URL, get back clean structured data in your chosen format.
POST
/v1/scrape/smart
Smart scrape (auto-routing)
Skip the browser when the page does not need it.
POST
/v1/scrape/batch
Batch scrape
Up to 100 URLs in parallel, one response.
POST
/v1/scrape/async
Async scrape
Queue a single scrape, receive a webhook when ready.
POST
/v1/scrape/batch/async
Async batch scrape
Fire-and-forget for large jobs.
GET
/v1/jobs/{id}
Job status
Poll any queued job.

Extraction

POST
/v1/extract/clean
Clean article extraction
Readability extraction — strips nav, ads, sidebars.
POST
/v1/extract/structured
Structured data extraction
JSON-LD, Microdata, OpenGraph, Twitter Card.

Intelligence

POST
/v1/dns/lookup
DNS lookup
Raw DNS records: A, MX, TXT, NS, CNAME, AAAA.
POST
/v1/dns/intelligence
DNS intelligence
Email provider, nameserver provider, SPF/DMARC, tech inference.
POST
/v1/intel/ssl
SSL certificate
Issuer, expiry, SANs, days remaining.
POST
/v1/intel/whois
WHOIS
Registrar, creation, expiry, contact emails, nameservers.
POST
/v1/intel/page
Page intelligence
Tech stack, contacts, logos, feeds, images.
POST
/v1/intel/sitemap
Sitemap unroll
Unroll any sitemap.xml, including nested index sitemaps.
POST
/v1/intel/robots
Robots compliance check
Is this path allowed for a given user agent?
POST
/v1/verify/email
Email verification
SMTP handshake, MX check, catch-all and disposable detection.

Crawling

POST
/v1/crawl
Full-site crawl
Walk the link graph of an entire site.

Actors

POST
/v1/actors/amazon
Amazon product actor
Structured product data from any Amazon product page.
POST
/v1/actors/zillow
Zillow property actor
Structured property data from any Zillow listing.
POST
/v1/actors/google-maps
Google Maps place actor
Structured place data from any Google Maps URL.
POST
/v1/actors/markdown
Markdown actor
LLM-ready markdown for any page.