Scrapy

What is Scrapy?

A Python-based, Cambuslang-created web-crawling framework, Scrapy is free and open-source. It was first created for online scraping, but it may also be used as a general-purpose web crawler or to extract data via APIs. Zyte, a web-scraping development and service provider, presently maintains it.