No-code AI
Connect Dify agents to Piloterr scraping APIs
Add Piloterr as a custom API tool or HTTP node in Dify workflows. Feed agents and chatbots structured JSON from protected sites, without maintaining scrapers.
- Custom API tools with x-api-key authentication
- OpenAPI or manual HTTP tool configuration
- Structured JSON for reliable agent answers
- Anti-bot bypass on every Piloterr call
At a glance
HTTP
API tools
400+
data sources
JSON
agent input
No-code
workflow builder
Why connect Dify
Agent tools in minutes
Point a Dify custom tool at any Piloterr endpoint, agents invoke scrapes during conversations and workflows.
Workflow orchestration
Chain scrape → LLM summarize → HTTP post steps in visual pipelines without writing glue code.
Knowledge + live data
Combine Dify knowledge bases with fresh web data from Piloterr for up-to-date answers.
Predictable billing
Credit-based Piloterr pricing per successful scrape, forecast costs as Dify agent usage grows.
Dify + Piloterr use cases
Popular no-code AI patterns with live web data.
Support chatbots
Agent scrapes docs and competitor pages before answering customer questions.
Sales enrichment bots
Look up company and LinkedIn data when a lead starts a chat.
Research assistants
News and SERP tools power internal research workflows.
Alert workflows
Scheduled Dify jobs scrape pages and notify teams when content changes.
Why Dify needs Piloterr instead of raw HTTP
| Approach | DIY | Piloterr |
|---|---|---|
| Dify HTTP node alone | 403 on protected sites | Clean JSON response |
| JavaScript pages | Empty HTML body | Headless rendering |
| HTML in prompts | Noisy agent context | Structured fields |
| Maintenance | Breaks on site changes | Managed schemas |
Connect Dify in four steps
Step 1
Get your API key
Copy x-api-key from the Piloterr dashboard.
Get your API keyStep 2
Open your Dify app
Create or edit an Agent / Workflow app in your Dify workspace.
Step 3
Add a custom API tool
Configure method, URL, headers (x-api-key), and JSON body schema from the Piloterr library docs.
Step 4
Test and publish
Run the agent in preview, verify JSON fields map correctly, then publish to your team.
Workflow recipes
News digest agent
Daily Dify workflow scrapes Google News and emails a summarized briefing.
Lead chat enrichment
Chat agent calls company + LinkedIn tools when visitors share a domain.
Competitor watch bot
Scheduled scrape compares pricing JSON and posts diffs to Slack via Dify HTTP step.
RAG + live scrape
Combine knowledge base retrieval with on-demand Piloterr page fetch for fresh answers.
When to pick Dify vs other platforms
Scenario
No-code AI agents and chatbots
Recommendation: Dify
Scenario
7,000+ SaaS app triggers
Recommendation: Zapier
Scenario
Self-hosted automation graphs
Recommendation: n8n
Scenario
IDE coding assistants
Recommendation: MCP
Dify custom API tool example
Configure a tool that searches Google News via Piloterr.
{
"name": "search_google_news",
"description": "Search Google News for recent articles matching a query.",
"method": "POST",
"url": "https://api.piloterr.com/v2/google/news",
"headers": {
"x-api-key": "{{PILOTERR_API_KEY}}",
"Content-Type": "application/json"
},
"body": {
"query": "{{query}}",
"location": "{{location}}",
"page": 1
},
"parameters": [
{ "name": "query", "type": "string", "required": true },
{ "name": "location", "type": "string", "required": false }
]
}
Zapier
Make
MCP
LangChainTransparent credit pricing
Pay only for successful requests. Start with +500 credits, then scale with plans from $49/mo.
Premium
$49/mo
18,000 credits
Premium+
$99/mo
40,000 credits
Startup
$249/mo
110,000 credits