Docs · Scraping

Async batch scrape

Fire-and-forget for large jobs.

POST /v1/scrape/batch/async

Queue any number of URLs, receive a single webhook callback when the batch completes. Built for production pipelines.

Parameters

Name Type Required Default Description
urls array yes — List of URLs (no upper bound on the async endpoint).
webhook_url string no — URL for the completion callback. Optional — you can also poll.
format string no markdown Output format.

Request

curl -X POST https://api.datasonar.dev/v1/scrape/batch/async \
  -H "Authorization: Bearer osk_..." \
  -d '{"urls": [...], "format": "markdown", "webhook_url": "https://..."}'

Response

{ "status": "queued", "job_id": "..." }

Related

POST /v1/scrape/batch
Batch scrape
GET /v1/jobs/{id}
Job status