Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.spidra.io/llms.txt

Use this file to discover all available pages before exploring further.

All Spidra SDKs wrap the same REST API with idiomatic helpers for your language: authentication, async job polling, error handling, and typed responses. Pick your language and you are up and running in a few lines of code. All SDKs are open source at github.com/spidra-io.

​
Every SDK supports

  • Scrape, batch scrape, and crawl
  • Browser actions and forEach
  • Structured output with JSON Schema
  • Authenticated scraping with session cookies
  • Stealth mode and proxy geo-targeting
  • Async job submission and automatic polling

​
Quick example

Every SDK follows the same pattern. Here is a scrape across all languages: 
import { SpidraClient } from 'spidra-js'

const spidra = new SpidraClient({ apiKey: process.env.SPIDRA_API_KEY })

const job = await spidra.scrape.run({
  urls: [{ url: 'https://example.com/products' }],
  prompt: 'Extract all product names and prices',
  output: 'json',
})

console.log(job.result.content)
run() submits the job and polls until it completes. Use submit() and get() separately if you need manual control over polling.

​
Official SDKs

Node.js

Supports TypeScript natively. Works in Next.js, Express, Bun, and edge runtimes. LangChain and Vercel AI SDK tool support built in.npm install spidra-js

Python

Async-first with sync wrappers. Works in scripts, Django, Flask, FastAPI, and Jupyter notebooks.pip install spidra

Go

Typed structs, idiomatic error handling, zero external dependencies. Standard library only.go get github.com/spidra-io/spidra-go

PHP

Requires PHP 8.1+ and Guzzle 7. Typed exceptions and configurable polling timeouts.composer require spidra/spidra-php

Ruby

Pure stdlib, no external dependencies. Works in Rails, Sinatra, and plain scripts.gem install spidra

Elixir

Idiomatic pattern matching, OTP-ready. Works with Phoenix and plain Mix projects.{:spidra, "~> 0.1.0"}

.NET

Fully async with Task/await. Typed exceptions and JSON schema support. Requires .NET 8+.dotnet add package Spidra

Swift

Native async/await concurrency. Works on iOS, macOS, tvOS, watchOS, and server-side Swift.Swift Package Manager — add via Xcode or Package.swift.

Java

Java 17+. CompletableFuture-based async, builder pattern, no extra HTTP dependencies.implementation 'io.spidra:spidra-java-sdk:0.1.0'

Rust

Built on tokio and reqwest. Native async/await, returns Result<T, SpidraError> on every call.cargo add spidra

​
Workflow integrations

n8n

Native node for n8n workflows. Trigger scrapes, batch jobs, and crawls as steps in any automation.Coming soon.

Zapier

Connect Spidra to 6,000+ apps without code. Trigger on schedule or on demand and send results anywhere.Coming soon.

MCP Server

Give any LLM live web access as a native tool. Works with Claude, GPT-4, and any MCP-compatible agent runtime.Coming soon.