Skip to main content
For some sites, Spidra knows how the pages are built and reads their data directly instead of rendering them in a browser. Send a link from one of these sites to Scrape or Batch scrape as usual: there’s nothing to turn on. You get the site’s own fields (prices, ratings, follower counts, salaries) as JSON, usually in a few seconds, for 1 credit per link.

The sites

How results come back

When Spidra cleans a link (removing tracking parameters or following a short link), the result has canonicalUrl; url stays the link you sent. Every site page lists the links that work and the fields you get. Most fields are optional on the site’s side, so a missing value comes back as null or an empty list, never a guess.

What’s free

A link that can’t be read costs nothing: a page that doesn’t exist, a page that needs a sign-in, a search with no results, or a page the site wouldn’t serve. The result says why in plain words.

When the browser is used instead

These links are read in a normal browser scrape (with the usual cost) when you ask for something only a browser can do:
  • a screenshot (screenshot or fullPageScreenshot);
  • browser actions or an instruction on the URL.
Pages on these sites that aren’t listed on their page are also read in a browser.

Signed-out only

Pages are read the way a signed-out visitor sees them, and Spidra doesn’t sign in to these sites. Your own cookies are used only where a site’s page says so (Amazon’s full review pages, Indeed’s search pages after the first); everywhere else they’re never sent. What needs an account (full LinkedIn profiles, Facebook groups) is listed on each site’s page. Check each site’s terms before you collect data from it; you’re responsible for how you use what you collect.

Ready-made tables

Templates turn the most common jobs on these sites into a form and a table: Google Maps leads, Amazon keyword rank, LinkedIn jobs, YouTube transcripts, Zillow homes in an area and more.