> ## Documentation Index
> Fetch the complete documentation index at: https://docs.spidra.io/llms.txt
> Use this file to discover all available pages before exploring further.

# List scrape logs

> Lists your past scrapes, newest first, with their settings, tokens and credits. Every scrape is logged, including each URL of a [batch](/api-reference/scraping/batch-scrape), and logs are kept after the job itself expires.

The list leaves out results. Get one with [Get a scrape log](/api-reference/scraping/scrape-logs-detail). A log's `uuid` isn't the scrape's `jobId`.




## OpenAPI

````yaml GET /scrape-logs
openapi: 3.1.0
info:
  title: Spidra API
  version: 1.0.0
  description: >-
    Public API endpoints for web scraping via Spidra. Authenticate with
    `Authorization: Bearer YOUR_API_KEY`.
servers:
  - url: https://api.spidra.io/api
security:
  - BearerAuth: []
  - ApiKeyAuth: []
paths:
  /scrape-logs:
    get:
      tags:
        - Scrape Logs
      summary: List scrape logs
      description: >
        Lists your past scrapes, newest first, with their settings, tokens and
        credits. Every scrape is logged, including each URL of a
        [batch](/api-reference/scraping/batch-scrape), and logs are kept after
        the job itself expires.


        The list leaves out results. Get one with [Get a scrape
        log](/api-reference/scraping/scrape-logs-detail). A log's `uuid` isn't
        the scrape's `jobId`.
      parameters:
        - name: page
          in: query
          description: The page to return, starting at 1.
          schema:
            type: integer
            minimum: 1
            default: 1
        - name: limit
          in: query
          description: Logs per page, from 1 to 100. Higher values are capped at 100.
          schema:
            type: integer
            minimum: 1
            maximum: 100
            default: 10
          example: 20
        - name: status
          in: query
          description: Only return logs with this status. `all` returns every status.
          schema:
            type: string
            enum:
              - all
              - success
              - error
              - in_progress
          example: success
        - name: searchTerm
          in: query
          description: Only return scrapes whose URLs contain this text.
          schema:
            type: string
          example: books.toscrape.com
        - name: channel
          in: query
          description: >-
            Only return scrapes from this channel. `api` is scrapes sent with an
            API key, and `playground` is scrapes run from the dashboard. `all`
            returns both.
          schema:
            type: string
            enum:
              - all
              - api
              - playground
        - name: dateStart
          in: query
          description: Only return scrapes started at or after this date, as `YYYY-MM-DD`.
          schema:
            type: string
          example: '2026-10-01'
        - name: dateEnd
          in: query
          description: Only return scrapes started at or before this date, as `YYYY-MM-DD`.
          schema:
            type: string
          example: '2026-10-31'
      responses:
        '200':
          description: One page of scrape logs and the total that match.
          content:
            application/json:
              schema:
                type: object
                properties:
                  status:
                    type: string
                    enum:
                      - success
                  data:
                    type: object
                    properties:
                      logs:
                        type: array
                        items:
                          $ref: '#/components/schemas/ScrapeLogSummary'
                        description: The logs on this page.
                      total:
                        type: integer
                        description: How many logs match the filters in all.
              example:
                status: success
                data:
                  logs:
                    - uuid: 54ec8875-c92c-40cc-8fb6-ba3f6d68c0ee
                      status: success
                      started_at: '2026-10-24T19:29:01.000Z'
                      finished_at: '2026-10-24T19:29:11.000Z'
                      error_message: ''
                      urls:
                        - url: >-
                            https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html
                          actions: []
                      extraction_prompt: Extract the book details
                      input_tokens: 571
                      output_tokens: 23
                      tokens_used: 594
                      captcha_solved_count: 0
                      scraped_sites_count: 1
                      ai_output_format: json
                      latency_ms: 9846
                      credits_used: 2
                      use_proxy: 1
                      proxy_country: ng
                      scrape_mode: default
                      extract_content_only: 0
                      schema_json: >-
                        {"type":"object","required":["title","price"],"properties":{"title":{"type":"string"},"price":{"type":"number"},...}}
                      screenshot: 0
                      full_page_screenshot: 0
                      page_title: A Light in the Attic | Books to Scrape - Sandbox
                    - uuid: 13fcab8f-5920-4a3a-a100-6fb764543827
                      status: success
                      started_at: '2026-10-24T19:28:20.000Z'
                      finished_at: '2026-10-24T19:28:57.000Z'
                      error_message: ''
                      urls:
                        - url: https://books.toscrape.com
                          actions: []
                      extraction_prompt: Return the title and price of every book on the page
                      input_tokens: 2628
                      output_tokens: 418
                      tokens_used: 3046
                      captcha_solved_count: 0
                      scraped_sites_count: 1
                      ai_output_format: json
                      latency_ms: 37458
                      credits_used: 3
                      use_proxy: 1
                      proxy_country: ng
                      scrape_mode: default
                      extract_content_only: 0
                      schema_json: null
                      screenshot: 0
                      full_page_screenshot: 0
                      page_title: All products | Books to Scrape - Sandbox
                  total: 3437
        '401':
          $ref: '#/components/responses/Unauthorized'
        '500':
          description: The logs couldn't be loaded. Try again.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
              example:
                status: error
                message: Something went wrong loading this. Try again.
components:
  schemas:
    ScrapeLogSummary:
      type: object
      description: >-
        One past scrape, as returned to an API key. Logs use snake_case field
        names. Flags such as `use_proxy` are `0` or `1`.
      properties:
        uuid:
          type: string
          format: uuid
          description: >-
            The log's ID. Not the same as the scrape's `jobId`. Use it with `GET
            /scrape-logs/{uuid}`.
        status:
          type: string
          enum:
            - success
            - error
            - in_progress
          description: >-
            `success` (finished), `error` (failed, `error_message` says why) or
            `in_progress` (still running).
        started_at:
          type: string
          format: date-time
          description: When the scrape started.
        finished_at:
          type:
            - string
            - 'null'
          format: date-time
          description: When it finished. `null` while it runs.
        error_message:
          type:
            - string
            - 'null'
          description: Why the scrape failed. Empty or `null` when it didn't.
        urls:
          type: array
          description: The URLs scraped, each with the browser actions it ran.
          items:
            type: object
            properties:
              url:
                type: string
                description: The URL.
              actions:
                type: array
                items:
                  type: object
                description: >-
                  The browser actions sent for this URL. Empty when there were
                  none.
        extraction_prompt:
          type:
            - string
            - 'null'
          description: The `prompt` sent, if any.
        input_tokens:
          type: integer
          description: Tokens the AI read. `0` when no AI was used.
        output_tokens:
          type: integer
          description: Tokens the AI wrote.
        tokens_used:
          type: integer
          description: '`input_tokens` plus `output_tokens`.'
        captcha_solved_count:
          type: integer
          description: CAPTCHAs solved across all URLs.
        scraped_sites_count:
          type: integer
          description: How many URLs were read.
        ai_output_format:
          type: string
          enum:
            - markdown
            - json
          description: The scrape's `output`.
        latency_ms:
          type:
            - integer
            - 'null'
          description: How long the scrape took, in milliseconds.
        credits_used:
          type: integer
          description: Credits the scrape cost.
        use_proxy:
          type: integer
          enum:
            - 0
            - 1
          description: '`1` when Stealth Mode was on.'
        proxy_country:
          type:
            - string
            - 'null'
          description: The country the scrape browsed from, when Stealth Mode was on.
        scrape_mode:
          type: string
          enum:
            - default
            - fast
          description: The scrape's `scrapeMode`.
        extract_content_only:
          type: integer
          enum:
            - 0
            - 1
          description: '`1` when `extractContentOnly` was on.'
        schema_json:
          type:
            - string
            - 'null'
          description: The `schema` sent, as a JSON string, if any.
        screenshot:
          type: integer
          enum:
            - 0
            - 1
          description: '`1` when a screenshot was asked for.'
        full_page_screenshot:
          type: integer
          enum:
            - 0
            - 1
          description: '`1` when a full-page screenshot was asked for.'
        page_title:
          type:
            - string
            - 'null'
          description: The title of the page that was read.
    ErrorResponse:
      type: object
      required:
        - status
        - message
      properties:
        status:
          type: string
          enum:
            - error
        message:
          type: string
          description: What went wrong, as a sentence you can show to a person.
        code:
          type: string
          description: >-
            A stable code for the error, when there is one, such as
            `JOB_NOT_FOUND` or `SERVICE_BUSY`. Branch on this rather than on
            `message`.
        errors:
          description: >-
            On validation errors (`422`), every problem with the request.
            Scrape, batch, crawl, map and search return a list of sentences.
            Templates, presets and monitors return `{ field, message }` objects.
          oneOf:
            - type: array
              items:
                type: string
            - type: array
              items:
                type: object
                properties:
                  field:
                    type: string
                  message:
                    type: string
        retry_after:
          type: integer
          description: >-
            On `503 SERVICE_BUSY`, how many seconds to wait before sending the
            request again.
  responses:
    Unauthorized:
      description: The API key is missing, wrong, or turned off.
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/ErrorResponse'
          examples:
            missing:
              summary: No key sent
              value:
                status: error
                message: Missing authentication
            invalid:
              summary: Wrong or turned-off key
              value:
                status: error
                message: Invalid token or API key
  securitySchemes:
    BearerAuth:
      type: http
      scheme: bearer
      bearerFormat: API key
    ApiKeyAuth:
      type: apiKey
      in: header
      name: x-api-key

````

This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.