Scry

Web scraping engines with Python and Scrapy
Alternatives To Scry
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Scrapy49,9184,1854452 months ago96September 18, 2023692bsd-3-clausePython
Scrapy, a fast high-level web crawling & scraping framework for Python.
Portia8,982927 months ago26May 25, 2015127bsd-3-clausePython
Visual scraping for Scrapy
Awesome Crawler5,859
4 months ago27mit
A collection of awesome web crawler,spider in different languages
Scrapely1,66810124 years ago13November 28, 201929HTML
A pure-python HTML screen-scraping library
Scrapy Cluster1,1371825 months ago15December 23, 202017mitPython
This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
Django Dynamic Scraper1,069
262 years ago65June 25, 202138bsd-3-clausePython
Creating Scrapy scrapers via the Django admin interface
Querido Diario944
2 months ago182mitPython
📰 Diários oficiais brasileiros acessíveis a todos | 📰 Brazilian government gazettes, accessible to everyone.
Kimuraframework874422 years ago10January 30, 201934mitRuby
Kimurai is a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HTTP requests and allows to scrape and interact with JavaScript rendered websites
Scrapyrt793
55 months ago7September 20, 202331bsd-3-clausePython
HTTP API for Scrapy spiders
Easy Scraping Tutorial618
3 years ago7mitJupyter Notebook
Simple but useful Python web scraping tutorial code.
Alternatives To Scry
Select To Compare


Alternative Project Comparisons
Popular Scrapy Projects
Popular Scraper Projects
Popular Data Processing Categories

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Scraper
Crawler
Cron
Torrent
Scrapy