cURL
curl --request GET \ --url https://api.spidra.io/api/crawl/{jobId} \ --header 'x-api-key: <api-key>'
{ "status": "completed", "progress": { "message": "Crawl complete", "pagesCrawled": 5, "maxPages": 10 }, "result": [ { "url": "https://example.com/blog/post-1", "title": "First Post", "status": "success", "data": { "title": "First Post", "author": "John", "date": "2025-01-01" } } ], "error": null }
Check crawl progress and get results
Documentation IndexFetch the complete documentation index at: https://docs.spidra.io/llms.txtUse this file to discover all available pages before exploring further.
Fetch the complete documentation index at: https://docs.spidra.io/llms.txt
Use this file to discover all available pages before exploring further.
The job ID returned from POST /crawl
Job status and results
waiting
active
completed
failed
Show child attributes
Was this page helpful?