Automation
Web scraping workflows in n8n with Piloterr
Use the HTTP Request node to call Piloterr APIs, or start from 30+ ready-made templates. Self-host or use n8n Cloud, route JSON into Sheets, Slack, and databases.
- HTTP Request node with x-api-key header auth
- 30+ copy-paste workflow templates on Piloterr
- Self-hosted or cloud, full control over data
- Iterator and Split Out nodes for batch processing
At a glance
30+
ready templates
HTTP
Request node
400+
API endpoints
JSON
node output
Why connect n8n
Ready-made templates
Import n8n workflows for Google News, LinkedIn, Amazon, Shopify, and more, already wired to Piloterr credentials.
HTTP Request node
Configure any Piloterr endpoint with method, headers, query params, and JSON body. Copy the n8n node JSON from any library endpoint.
Self-hosted option
Run n8n on your infrastructure for data residency and unlimited workflow executions.
Complex pipelines
Branch, loop, wait, and merge, build multi-step scraping pipelines that no-code tools can't match.
n8n + every Piloterr API
From simple HTTP calls to full monitoring systems with deduplication and alerting.
Scraper APIs
All library endpoints accessible via HTTP Request node.
Template library
Pre-built workflows with Schedule triggers, Sheets output, and duplicate detection.
Batch processing
Split Out and Loop Over Items for processing hundreds of URLs per run.
Webhook triggers
Expose scrapes on-demand via n8n webhooks integrated with your app.
Why n8n + Piloterr beats DIY scraping
| Approach | DIY | Piloterr |
|---|---|---|
| HTTP node alone | Blocked on protected sites | Anti-bot bypass included |
| Puppeteer in n8n | Heavy, fingerprint leaks | Managed headless Chrome |
| Maintenance | Custom selectors break | Stable JSON endpoints |
| Getting started | Build from scratch | 30+ importable templates |
Scrape from n8n in four steps
Step 1
Get your API key
Copy x-api-key from the Piloterr dashboard.
Step 2
Add HTTP Request node
Set URL to your endpoint, method to POST/GET, and add x-api-key header.
Step 3
Or import a template
Browse ready-made workflows and import the JSON into n8n.
Or import a templateStep 4
Connect downstream nodes
Route JSON to Google Sheets, Slack, PostgreSQL, or any n8n integration.
Workflow recipes
Schedule → scrape → Sheets
Daily Google News monitoring with duplicate detection, template available.
Webhook → enrich → CRM
On-demand LinkedIn enrichment triggered by your app's webhook.
Competitor monitoring → Slack
Track SERP positions and post changes to a Slack channel.
Batch URLs → scrape → Notion
Read URLs from a spreadsheet, loop HTTP Request nodes, and append structured rows to Notion.
When to pick n8n vs SDK
Scenario
Self-hosted automation with branching
Recommendation: n8n
Scenario
Tight loops at 1M+ req/mo
Recommendation: Python SDK
Scenario
Quick start with templates
Recommendation: n8n templates
Scenario
Non-technical users
Recommendation: Zapier or Make
n8n HTTP Request node config
Import this node JSON or configure manually in the HTTP Request node.
{
"name": "Piloterr Google News",
"type": "n8n-nodes-base.httpRequest",
"typeVersion": 4.2,
"parameters": {
"url": "https://api.piloterr.com/v2/google/news",
"method": "POST",
"sendHeaders": true,
"headerParameters": {
"parameters": [
{ "name": "x-api-key", "value": "YOUR_API_KEY" },
{ "name": "Content-Type", "value": "application/json" }
]
},
"sendBody": true,
"specifyBody": "json",
"jsonBody": "={\"query\": \"stocks\", \"location\": \"Paris, FR\", \"page\": 1}"
}
}
Zapier
Make
LangChain
Google Apps ScriptTransparent credit pricing
Pay only for successful requests. Start with +500 credits, then scale with plans from $49/mo.
Premium
$49/mo
18,000 credits
Premium+
$99/mo
40,000 credits
Startup
$249/mo
110,000 credits