cURL
curl --request GET \ --url https://api.spidra.io/api/crawl/{jobId} \ --header 'x-api-key: <api-key>'
{ "status": "completed", "progress": { "message": "Crawl complete", "pagesCrawled": 5, "maxPages": 10 }, "result": [ { "url": "https://example.com/blog/post-1", "title": "First Post", "status": "success", "data": { "title": "First Post", "author": "John", "date": "2025-01-01" } } ], "error": null }
Check crawl progress and get results
The job ID returned from POST /crawl
Job status and results
waiting
active
completed
failed
Show child attributes
Was this page helpful?