Zum Hauptinhalt springen
Netzwerkstatus
Anmelden
Piloterr
Zurück zur Bibliothek

API Website WebUnlocker

Bypass advanced anti-bot systems (Cloudflare, DataDome, Akamai, PerimeterX) on whitelisted domains. Combines browser rendering and unlock tooling; use after Crawler and Rendering fail.

Aktiv3 Credits = 1 AnfrageGET/v2/website/webunlocker
Endpunkt kostenlos testenPiloterr

Endpunkt-Übersicht

Detaillierte Dokumentation, Preise und Anwendungsbeispiele.

Choosing the right endpointLink to Choosing the right endpoint

Piloterr exposes three complementary ways to fetch a public web page. Pick the lightest engine that works for your target site.

Endpoint Engine Credits Use when
Website Crawler HTTP request (no JavaScript) 1 The HTML you need is already in the first response: blogs, docs, server-rendered catalog pages, sitemaps.
Website Rendering Headless browser (JavaScript executed) 2 Content appears only after JS runs: React/Vue/Angular SPAs, lazy-loaded listings, pages that need wait_for or POST browser_instructions.
Website WebUnlocker Browser + unlock stack 3 Website Rendering or Website Crawler hit bot walls (Cloudflare, DataDome, Akamai, PerimeterX) and the domain is on Piloterr's approved whitelist.

Decision flow

  1. Try Crawler first if you do not need client-side rendering. It is the fastest and cheapest option.
  2. Switch to Rendering when the DOM is empty, prices load asynchronously, or you must wait for a selector / run browser steps.
  3. Escalate to WebUnlocker only for hardened retail or marketplace domains that block normal browser traffic. Whitelist approval is required before production use.

See also: Website Scraping guide.

OverviewLink to Overview

Website WebUnlocker is the hardest tier of the website stack. It combines headless rendering with an unlock layer tuned for enterprise bot managers. Use it when:

Whitelist required: the target hostname must be approved on Piloterr's approved whitelist before production traffic. Contact Piloterr support to request new domains.

Beta: behavior and supported domains may evolve.

Costs 3 credits per successful call.

QuickstartLink to Quickstart

GET https://api.piloterr.com/v2/website/webunlocker?query=https://www.norauto.fr/t/pneu/w-185-h-55-r-14/ete-s/80-l-h-q.html

ParametersLink to Parameters

Parameter Type Required Description
query string yes Public URL (http/https). Domain must be whitelisted
allow_redirects boolean no Follow redirects when true (default)
return_page_source boolean no Raw HTML when true. Default false

ResponseLink to Response

Field Description
Response body HTML after bypassing bot protection

Related endpointsLink to Related endpoints

Situation Endpoint
No advanced bot wall Website Crawler or Website Rendering (cheaper)
Check which engine a site needs Website Antibot
Stack detection on a URL Website Technology

Example whitelisted domains include mobile.de, leroymerlin.fr, and norauto.fr.

NotesLink to Notes

  • Do not start with WebUnlocker: validate Crawler and Rendering first to save credits.
  • Whitelist is per domain; subdomains may require separate approval.
  • For standard JS rendering without whitelist, use Website Rendering instead.

Main use casesLink to Main use cases

  • Product and listing pages on DataDome or Akamai-protected retailers
  • Automotive and home-improvement marketplaces on approved domains
  • Pipelines where Rendering consistently returns challenge pages
  • Competitive price monitoring on hardened e-commerce sites

Verwandte APIs

Erweitern Sie Ihre Datenmöglichkeiten mit diesen ergänzenden Tools.

Alle anzeigen
Website Antibot/v2/website/antibot

Erkennen Sie den Anti-Bot-Schutz einer Website vor dem Scraping. Vendor, Konfidenz und Hinweise in einem Aufruf.

GET1 Credit = 1 AnfrageAktiv
Website Crawler (POST)/v2/website/crawler

Webseiten und API-Endpunkte per URL crawlen und strukturierte JSON-Antworten per POST abrufen.

POST1 Credit = 1 AnfrageAktiv
Website Crawler/v2/website/crawler

Fetch public pages with fast HTTP crawling (no JavaScript). Best first choice for static or server-rendered HTML; use Rendering or WebUnlocker when JS or anti-bot blocks you.

GET1 Credit = 1 AnfrageAktiv
Website Email Phone Extractor/v2/website/email_phone_extractor

Extrahieren Sie E-Mails und Telefonnummern von Websites für umfassende Kontaktdaten, einschließlich Social-Media-Profile auf über 12 Plattformen.

GET1 Credit = 1 AnfrageAktiv
Website Rendering/v2/website/rendering

Render JavaScript-heavy pages in a headless browser and return post-render HTML. Use when Crawler returns empty DOM; escalate to WebUnlocker if bot protection blocks the session.

GET2 Credits = 1 AnfrageAktiv
Website Rendering Instructions (POST)/v2/website/rendering

Führen Sie Browser-Automatisierungsanweisungen (scroll, scroll_to_bottom) während des Headless-Renderings aus, um Lazy-Loading-Inhalte auszulösen, Bot-Erkennung zu umgehen und dynamisch geladene Seiten zu scrapen.

POST2 Credits = 1 AnfrageAktiv
Website Screenshot/v2/website/screenshot

Screenshot API mit Browser-Rendering: erfasst Webseiten als PNG/JPEG/WebP oder PDF für Previews, QA, Reporting, Monitoring und Archivierung ohne Headless-Infrastruktur.

GET2 Credits = 1 AnfrageAktiv
Website Technology/v2/website/technology

Identifizieren Sie die Technologien hinter jeder Website CMS, Frameworks, Analytics, CDN, Hosting: für Wettbewerbsanalyse und technologische Einblicke.

GET1 Credit = 1 AnfrageAktiv
Website WebUnlocker (POST)/v2/website/webunlocker

Senden Sie POST-Anfragen an freigeschaltete Websites oder APIs über WebUnlocker, um fortschrittlichen Anti-Bot-Schutz zu umgehen und die Upstream-Antwort abzurufen.

POST3 Credits = 1 AnfrageAktiv

Bereit loszulegen?

Ihre Web-Scraping-API ist nur einen Klick entfernt. Starten Sie mit +500 Credits, ohne Infrastruktur einrichten zu müssen, ohne Proxys zu verwalten und ohne Kreditkarte.

  • +500 Credits
  • Keine Kreditkarte erforderlich
  • Alle Endpunkte enthalten
Kostenlos starten (+500 Credits)PiloterrMit einem Datenexperten sprechen