Skip to main content
GET
/
crawl
/
{jobId}
Get Crawl Job Status
curl --request GET \
  --url https://api.spidra.io/api/crawl/{jobId} \
  --header 'x-api-key: <api-key>'
{
  "status": "completed",
  "progress": {
    "message": "Crawl complete",
    "pagesCrawled": 5,
    "maxPages": 10
  },
  "result": [
    {
      "url": "https://example.com/blog/post-1",
      "title": "First Post",
      "status": "success",
      "data": {
        "title": "First Post",
        "author": "John",
        "date": "2025-01-01"
      }
    }
  ],
  "error": null
}
Unlike scrape, crawl returns an array of results - one object per crawled page.

Authorizations

x-api-key
string
header
required

Path Parameters

jobId
string
required

The job ID returned from POST /crawl

Response

Job status and results

status
enum<string>
Available options:
waiting,
active,
completed,
failed
progress
object
result
object[] | null
error
string | null