Skip to content

Web data platform

Turn any websiteinto structured data.

Fetch, render, extract and monitor any page through one API. ScrapeNest owns the browsers, the egress and the retries; you get clean JSON, artifacts and a webhook the moment a page changes.

Free to start. No credit card required.

3 engines/one API/built in France

POST /v1/jobslive
$ curl -sX POST https://api.scrapenest.com/v1/jobs \
  -H "X-API-Key: $SCRAPENEST_KEY" \
  -d '{ "job_type": "standard", "target_url": "…/pricing",
       "extraction": { "hooks": [{ "hook_id": "price",
         "type": "css", "selector": ".price" }] },
       "artifact_options": { "include_extraction": true } }'
queuedjob_8Q2f1 accepted · job_type=standard
·egressleased clean IP · TLS profile matched
·renderDOM ready · 1 selector resolved
·extractprice → "€149.00"
·storedartifact bundle · webhook sent
Submit a job. Poll it, or let a signed webhook find you.
Price monitoringChange detectionAnti-bot evasionTLS fingerprintingStructured JSONScreenshots & HARSigned webhooksOpenAPI + SDKsRBACIdempotent retriesLegal holdsArtifact storagePrice monitoringChange detectionAnti-bot evasionTLS fingerprintingStructured JSONScreenshots & HARSigned webhooksOpenAPI + SDKsRBACIdempotent retriesLegal holdsArtifact storage
3 engines

HTTP, headless Chromium and a fingerprint-hardened browser, one API

1 API

OpenAPI spec and typed SDKs for jobs, monitors and artifacts

EU-only

data residency, built and hosted in France

Every run

an artifact bundle, a manifest and an audit trail

Three moving parts, none of them yours

You describe the work. We own the ugly middle. The result lands somewhere you can reach it.

STEP 01
01

Submit

POST a job with a target URL, the engine you want, and optional extraction rules. One key, one endpoint, scoped to your organization.

STEP 02
02

We execute

We pick a clean egress IP, render JavaScript when the page needs it, retry transient failures with backoff, and quarantine the ones that don't recover. Durable orchestration means a job always reaches a definite end - it never silently disappears.

STEP 03
03

You collect

Pull the artifact bundle - rendered HTML, parsed JSON, screenshots, HAR, run metadata - or get a signed webhook the moment it's ready. Artifacts live in object storage on your retention policy.

Pick the engine that fits the target

Same API, three execution profiles. Start cheap and fast; reach for the heavy machinery only when a site forces you to.

01

Light

HTTP (TLS impersonation)

As fast as curl, dressed like a browser

Pure HTTP that mimics the TLS fingerprints and headers of real browsers. No browser, no render cost - the cheapest, fastest way to pull JSON APIs and server-rendered HTML at volume.

APIs · static HTML · high volume

1 credit / job

02

Standard

Playwright + Chromium

Render the page, drive it like a user

Headless Chromium that runs the page's JavaScript, then clicks, scrolls, paginates, fills forms and captures screenshots or HAR. The workhorse for SPAs and multi-step flows behind a login.

SPAs · interactions · logged-in flows

5 credits / job

03

Stealth

Fingerprint-hardened browser

For the targets that fight back

Fingerprint-hardened browser automation for sites with serious bot defenses (Cloudflare, Akamai, DataDome). Reach for it when Standard gets blocked - not before, because it's the priciest path.

Hostile targets · heavy anti-bot

30 credits / job

Structured output & forensics

Every job returns a bundle, not just a blob.

Each run is captured end to end: the extracted JSON, a rendered snapshot, the response headers and a full request trace, sealed with a signed manifest. When a result looks off, you replay the job and see exactly what the browser saw - no guesswork, no blind re-scrape.

  • Clean JSON plus HTML, screenshot and HAR in one artifact bundle
  • Status, timing, response headers and a rendered snapshot per run
  • Immutable audit trail and a signed manifest for every job
Job / job_8Q2f1completed

status

HTTP 200

completed

duration

3.92s

end to end

artifacts

4 files

bundle

security

clean

egress scan

targethttps://shop.example.eu/p/48213standard
  • page.html.gz30.6 KB
  • extraction.json1.2 KB
  • screenshot.png148 KB
  • trace.har72 KB
artifact bundle · signed manifest · audit trail

Monitoring & change detection

Watch a page. Know the moment it changes.

Put any scrape on a schedule and ScrapeNest fingerprints the result each run. When the part you care about changes, you get a signed webhook and a before/after diff - not another full dataset to compare by hand.

  • Cron-scheduled monitors with a complete run history
  • Change detection on a selector, page text, JSON or extracted fields
  • Signed webhook and email the moment a change clears your threshold
Monitor / competitor-pricingactive
cron
0 * * * * · Europe/Paris
engine
standard · next run 14:00
history
1,428 runs · 0 skipped
Change detected13:00:04 · ratio 0.08
  {
-   "price": "EUR 49",
+   "price": "EUR 39",
    "in_stock": true
  }
schedule.change_detected · webhook delivered

What you don't have to build

The parts of a scraping platform that look trivial in a demo and eat a quarter in production.

01

A flaky target won't wake you up

Transient failures heal themselves - idempotent dispatch, exponential backoff and a dead-letter queue for the genuinely broken. No 2 a.m. page for a site that was down for a minute.

02

Reach the pages behind JavaScript

Click, scroll, wait for selectors and fill forms like a real user. Fingerprint-hardened stealth for the targets that fight back, plain Chromium when they don't.

03

Get JSON, not a second pipeline

Ship CSS/XPath/JSONPath rules with the job and the structured data comes back with the result - or take the readability-cleaned article. Nothing extra to run.

04

Stop polling for results

Completed jobs come to you: signed payloads, replay protection, automatic retries and delivery tracking. Wire the webhook once and move on.

05

Never guess why a job behaved that way

Every run is traceable end to end - per-job metrics, structured logs and a request ID you can follow from API call to stored artifact.

06

An API your team can adopt in an afternoon

OpenAPI spec, typed SDKs and a console playground for the debug loop. Predictable errors and no surprises in the contract.

05Security & compliance

Built for buyers with a procurement team

Hard multi-tenant isolation, deny-by-default RBAC, hashed API keys, full audit trails, and GDPR/NIS2-aligned controls. The questionnaire answers are already written down.

Scrape your first page in ten minutes

Free to start. No call required to see it work - the call is for when you're ready to scale.