Skip to main content

A high-level Web Crawling and Web Scraping framework

Project description

Scrapy

PyPI Version Supported Python Versions Ubuntu macOS Windows Coverage report Conda Version Ask DeepWiki

Scrapy is a web scraping framework to extract structured data from websites. It is cross-platform, and requires Python 3.9+. It is maintained by Zyte (formerly Scrapinghub) and many other contributors.

Install with:

pip install scrapy

And follow the documentation to learn how to use it.

If you wish to contribute, see Contributing.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page