How about cookies? 🍪
Cookies enhance your experience and help us analyze traffic. By clicking "Accept all" you consent to storing cookies on your device.

Adjust preferences or withdraw consent anytime by clicking on "Cookie preferences" or on the dedicated footer link.


View our Privacy Policy for more information.

How to Scrape Google News with n8n

Scrape Google News automatically! Use n8n, Piloterr API & Google Sheets to monitor news by keywords and build your media database.

n8n logo

n8n

make logo

Make

zapier logo

Zapier

Manually tracking news across multiple sources is overwhelming and inefficient. Constantly refreshing Google News, copying links, checking for duplicates - these tasks consume valuable time that could be spent analyzing the actual content.

With this n8n workflow powered by Piloterr's Google News API, you can automate news scraping based on specific keywords and get a comprehensive list of articles delivered straight to your Google Sheet.

What does this n8n workflow do?

  • Automatically scrapes Google News for articles matching your keywords
  • Filters results by location and search parameters
  • Detects and prevents duplicate articles from being added
  • Retrieves complete article metadata including titles, sources, and snippets
  • Stores all data in a structured Google Sheet for easy analysis
  • Runs on a customizable schedule to keep your news feed updated

How it works

This automation combines several powerful components:

  1. Schedule Trigger: Runs the workflow automatically at defined intervals
  2. Piloterr Google News API: Searches for news articles based on your criteria
  3. Duplicate detection system: Checks existing entries to avoid redundant data
  4. Batch processing: Handles multiple articles efficiently
  5. Google Sheets integration: Stores all discovered articles with their metadata

Settings & Features

The workflow is highly customizable with advanced settings including:

  • Keyword targeting: Define specific search terms for your industry or interests
  • Location filtering: Target news from specific geographic regions
  • Page control: Define how many result pages to process
  • Automated scheduling: Set up recurring scraping intervals
  • Duplicate prevention: Automatically skips articles already in your database
  • Batch processing: Handles large volumes of articles without overwhelming the system

Google Sheet Output

Each discovered article is logged with comprehensive metadata:

  • Link: Direct URL to the full article
  • Title: Complete article headline
  • Domain: Source website domain
  • Source: Publisher name
  • Snippet: Article preview text
  • Position: Ranking position in search results
  • Displayed Link: Formatted URL as shown in search results
  • Snippet Matched: Highlighted keywords in the preview

Benefits

  • Time-saving: Automate hours of manual news monitoring in minutes
  • Comprehensive coverage: Never miss important articles in your field
  • Organized data: All articles neatly structured in your Google Sheet
  • Duplicate-free results: Built-in filtering prevents redundant entries
  • Scalable monitoring: Track multiple keywords and sources simultaneously
  • Real-time updates: Stay current with automated scheduling
  • Easy analysis: Structured data ready for further processing or sharing

How to use this n8n Google News template ?

  1. Make a copy of the Google Sheet template with the required columns
  2. Import the n8n workflow template
  3. Configure your Piloterr API credentials in the "Edit Fields" node
  4. Set your search parameters (keywords, location, pages)
  5. Configure the schedule trigger for your preferred update frequency
  6. Activate the workflow to start scraping Google News

The system will begin searching for news articles based on your settings and populate your Google Sheet with relevant articles, automatically avoiding duplicates and maintaining a clean, organized database.

Advanced Customization

This workflow can be easily modified to support multiple search queries, different scheduling patterns, or additional data processing steps. The modular design allows for seamless integration with other automation tools or notification systems.

Need help customizing the workflow for specific news monitoring requirements? Contact me for assistance with advanced configurations, webhook integrations, or custom filtering options.