Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Scrapy Rabbitmq | 76 | 1 | 2 years ago | 2 | July 02, 2015 | 3 | mit | Python | ||
A RabbitMQ Scheduler for Scrapy | ||||||||||
Distributed Multi User Scrapy System With A Web Ui | 71 | 6 years ago | 5 | Python | ||||||
Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner | ||||||||||
Scrapy Distributed | 40 | a year ago | 8 | February 20, 2021 | 10 | Python | ||||
A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy. | ||||||||||
Scrapy Boilerplate | 32 | a year ago | 16 | mit | Python | |||||
Scrapy project boilerplate done right | ||||||||||
Crawlerx | 16 | a year ago | 33 | apache-2.0 | SCSS | |||||
CrawlerX - Develop Extensible, Distributed, Scalable Crawler System which is a web platform that can be used to crawl URLs in different kind of protocols in a distributed way. | ||||||||||
Scrapy Rabbitmq Publisher | 12 | 2 years ago | 2 | February 18, 2019 | mit | Python | ||||
Scrapy Item Pipeline to send items to RabbitMQ. From https://medium.com/python4you/rabbitmq-scrapy-item-publisher-in-python-4c66a985e3cb | ||||||||||
Scrapy Mq Redis | 10 | 8 years ago | gpl-3.0 | Python | ||||||
A RabbitMQ/Redis tool for Scrapy | ||||||||||
Gerapyrabbitmq | 8 | 5 months ago | 2 | Python | ||||||
Distribution Support for Scrapy & Gerapy using RabbitMQ | ||||||||||
Scrapy Insights | 8 | 9 years ago | 1 | Python | ||||||
A scraper which scrapes the facebook insights API |