Docs · Scraping

Async scrape

Queue a single scrape, receive a webhook when ready.

POST /v1/scrape/async

For pages that are slow to render or when you do not want to hold an HTTP connection open. Returns a job_id immediately and POSTs to your webhook when the result is ready.

Parameters

Name Type Required Default Description
url string yes — URL to fetch.
webhook_url string yes — HTTPS URL where the result will be POSTed.
format string no markdown Output format.

Request

curl -X POST https://api.datasonar.dev/v1/scrape/async \
  -H "Authorization: Bearer osk_..." \
  -d '{"url": "https://example.com", "webhook_url": "https://yourapp.com/callback"}'

Response

{
  "status": "queued",
  "job_id": "c5584f4b-07f8-4329-8484-44eebf6b6e48"
}

Related

POST /v1/scrape/batch/async
Async batch scrape
GET /v1/jobs/{id}
Job status