> ## Documentation Index
> Fetch the complete documentation index at: https://docs.spidra.io/llms.txt
> Use this file to discover all available pages before exploring further.

# Introduction

> Search, scrape and crawl the web and get clean markdown or JSON back, from the dashboard, the API, an SDK or an AI assistant.

<img className="block dark:hidden" src="https://mintcdn.com/spidra/47EJpglRIcFOVcnQ/images/Spidra-Documentation-HEADER.png?fit=max&auto=format&n=47EJpglRIcFOVcnQ&q=85&s=a081b0cae8d7b05194bb8e1867896b6f" alt="Spidra Documentation" width="1080" height="352" data-path="images/Spidra-Documentation-HEADER.png" />

<img className="hidden dark:block" src="https://mintcdn.com/spidra/47EJpglRIcFOVcnQ/images/Spidra-Documentation-HEADER.png?fit=max&auto=format&n=47EJpglRIcFOVcnQ&q=85&s=a081b0cae8d7b05194bb8e1867896b6f" alt="Spidra Documentation" width="1080" height="352" data-path="images/Spidra-Documentation-HEADER.png" />

Spidra helps you get data off the web while you focus on your work.

You can search for pages, scrape the ones you know, or crawl a whole site, then describe what you want back and receive clean markdown or JSON. Spidra runs the real browsers, proxies, CAPTCHA solving and AI extraction, so you don't build any of it.

New here? [How Spidra works](/how-spidra-works) explains the four tools and what a result looks like, in about five minutes.

## What Spidra can do

<CardGroup cols={2}>
  <Card title="Search" icon="magnifying-glass" href="/features/search">
    Find pages across the web, news, images, videos, research papers and GitHub, and optionally read each result.
  </Card>

  <Card title="Scrape" icon="magnifying-glass-plus" href="/features/playground">
    Give Spidra up to 3 URLs and say what you want. It loads each page in a real browser and returns the data.
  </Card>

  <Card title="Crawl" icon="sitemap" href="/features/crawling">
    Start from one URL, describe which pages to follow, and get one result per page, up to 50 pages.
  </Card>

  <Card title="Batch scrape" icon="layer-group" href="/features/batch-scraping">
    Submit up to 50 URLs in one request. Each URL gets its own result.
  </Card>

  <Card title="Structured output" icon="file-code" href="/features/structured-output">
    Define a JSON schema so every result has the same fields and types.
  </Card>

  <Card title="Browser actions" icon="hand-pointer" href="/features/actions">
    Click, scroll, type and wait before extracting, or loop over every item with forEach.
  </Card>

  <Card title="Authenticated scraping" icon="key" href="/features/authenticated-scraping">
    Pass your own session cookies to read pages behind a login.
  </Card>

  <Card title="Stealth Mode" icon="user-secret" href="/features/stealth-mode">
    Send requests through residential proxies in the country you pick. CAPTCHAs are solved for you.
  </Card>
</CardGroup>

## Pricing and limits

Everything runs on credits. A scrape costs 1 credit per page plus a little for AI extraction, and a failed job is free. See [how credits work](/billing/how-credits-work), compare [plans](/billing/plans), or check the [rate limits](/api-reference/rate-limits).

## SDKs and integrations

Official libraries for every major language and platform. All open source on [GitHub](https://github.com/spidra-io).

### Programming languages

<CardGroup cols={5}>
  <Card title="Python" icon="python" color="#3776AB" href="/sdks/python" horizontal />

  <Card title="Node.js" icon="node" color="#339933" href="/sdks/node" horizontal />

  <Card title="Go" icon="golang" color="#00ADD8" href="/sdks/go" horizontal />

  <Card title="PHP" icon="php" color="#777BB4" href="/sdks/php" horizontal />

  <Card title="Ruby" icon="gem" color="#CC342D" href="/sdks/ruby" horizontal />

  <Card title="Java" icon="java" color="#ED8B00" href="/sdks/java" horizontal />

  <Card title="Elixir" icon="erlang" color="#A067E6" href="/sdks/elixir" horizontal />

  <Card title=".NET" icon="microsoft" color="#512BD4" href="/sdks/dotnet" horizontal />

  <Card title="Swift" icon="swift" color="#FA7343" href="/sdks/swift" horizontal />

  <Card title="Rust" icon="rust" color="#DEA584" href="/sdks/rust" horizontal />
</CardGroup>

### AI frameworks and automation

<CardGroup cols={3}>
  <Card title="MCP Server" icon="robot" color="#10A37F" href="/sdks/mcp">
    Connect Spidra directly to Claude, Cursor, and any MCP-compatible AI agent.
  </Card>

  <Card title="LangChain" icon="link-simple" color="#38BDF8" href="/sdks/langchain">
    Integrate Spidra scraping and data extraction into LangChain workflows.
  </Card>

  <Card title="n8n Integration" icon="bolt" color="#FF6D5A" href="/sdks/n8n">
    Automate web scraping pipelines with low-code n8n workflows.
  </Card>
</CardGroup>

## Contact and community

Get support, report bugs, and chat with us. Join our Discord for live text chat, visit GitHub to track development, or drop us an email for direct inquiries.

<CardGroup cols={3}>
  <Card title="Discord Community" icon="discord" color="#5865F2" href="https://discord.gg/spidra">
    Join our Discord for live text chat, community support, and product updates.
  </Card>

  <Card title="GitHub" icon="github" color="#6e7681" href="https://github.com/spidra-io">
    Explore our open-source repos, report issues, or contribute to SDK development.
  </Card>

  <Card title="Email Us" icon="envelope" color="#5865F2" href="mailto:hello@spidra.io">
    Drop us an email for direct support, sales inquiries, or technical assistance.
  </Card>
</CardGroup>


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.