Skip to main content
Network status
Log in
Piloterr
Back to library

Website Crawler (POST) API

A robust solution for efficiently extracting a wide range of data from web pages.

Active1 credit = 1 requestPOST/v2/website/crawler
Try endpoint for freePiloterr

Endpoint Overview

Detailed documentation, pricing, and usage examples.

OverviewLink to Overview

A robust solution for efficiently extracting a wide range of data from web pages.

QuickstartLink to Quickstart

POST https://api.piloterr.com/v2/website/crawler
Content-Type: application/json

{"query": "https://www.seloger-bureaux-commerces.com/api/classifieds/search"}

ParametersLink to Parameters

Parameter Type Required Description
query string yes Search query or target identifier

Main use casesLink to Main use cases

  • Integrate Website Crawler (POST) data into enrichment, analytics, and monitoring pipelines
  • Automate large-scale extraction from Website without maintaining scrapers
  • Power internal dashboards and workflow automations with live Website data

Related APIs

Expand your data capabilities with these complementary tools.

View All
Website Antibot/v2/website/antibot

Detect which anti-bot protection protects a website before you scrape. Get the vendor, confidence level, and matching clues from a single URL check.

GET1 credit = 1 requestActive
Website Crawler/v2/website/crawler

Fetch public pages with fast HTTP crawling (no JavaScript). Best first choice for static or server-rendered HTML; use Rendering or WebUnlocker when JS or anti-bot blocks you.

GET1 credit = 1 requestActive
Website Email Phone Extractor/v2/website/email_phone_extractor

Extract emails and phone numbers from websites for comprehensive contact details, including social media profiles across 12+ platforms.

GET1 credit = 1 requestActive
Website Rendering/v2/website/rendering

Render JavaScript-heavy pages in a headless browser and return post-render HTML. Use when Crawler returns empty DOM; escalate to WebUnlocker if bot protection blocks the session.

GET2 credits = 1 requestActive
Website Rendering Instructions (POST)/v2/website/rendering

Execute browser automation instructions (scroll, scroll_to_bottom) during headless rendering to trigger lazy-loaded content, bypass anti-bot detection, and scrape dynamically loaded pages.

POST2 credits = 1 requestActive
Website Screenshot/v2/website/screenshot

Browser-like Screenshot API that captures webpages as PNG/JPEG/WebP or PDF for previews, QA, reporting, monitoring, and archiving no headless setup.

GET2 credits = 1 requestActive
Website Technology/v2/website/technology

Identify the technologies behind any website CMS, frameworks, analytics, CDN, hosting, and more, for competitive market analysis and technological insight.

GET1 credit = 1 requestActive
Website WebUnlocker/v2/website/webunlocker

Bypass advanced anti-bot systems (Cloudflare, DataDome, Akamai, PerimeterX) on whitelisted domains. Combines browser rendering and unlock tooling; use after Crawler and Rendering fail.

GET3 credits = 1 requestActive
Website WebUnlocker (POST)/v2/website/webunlocker

Send POST requests to whitelisted websites or APIs through WebUnlocker to bypass advanced anti-bot protection and retrieve the upstream response.

POST3 credits = 1 requestActive

Ready to get started?

Your web scraping API is one click away. Start with +500 credits, no infrastructure to set up, no proxies to manage, and no credit card required.

  • +500 credits
  • No credit card required
  • All endpoints included
Start free (+500 credits)PiloterrTalk to a data expert